-- Logs begin at Mon 2021-12-27 13:41:59 UTC, end at Mon 2021-12-27 14:44:23 UTC. -- Dec 27 14:12:56.622363 dv-cinder-823015-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 27 14:12:56.631910 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 27 14:12:56.634163 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Dec 27 14:12:56 2021] *** Dec 27 14:12:56.634163 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 27 14:12:56.634163 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 27 14:12:56.634163 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: nodename: dv-cinder-823015-1-iscsi Dec 27 14:12:56.634163 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: machine: x86_64 Dec 27 14:12:56.634163 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: clock source: unix Dec 27 14:12:56.634163 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: pcre jit disabled Dec 27 14:12:56.634163 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: detected number of CPU cores: 4 Dec 27 14:12:56.634163 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: current working directory: / Dec 27 14:12:56.634163 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: detected binary path: /usr/bin/uwsgi-core Dec 27 14:12:56.634163 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: your processes number limit is 47680 Dec 27 14:12:56.634163 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: your memory page size is 4096 bytes Dec 27 14:12:56.634966 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: detected max file descriptor number: 2048 Dec 27 14:12:56.634966 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: lock engine: pthread robust mutexes Dec 27 14:12:56.634966 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: thunder lock: enabled Dec 27 14:12:56.634966 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 27 14:12:56.634966 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 27 14:12:56.679655 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: Python main interpreter initialized at 0x55f505fad9c0 Dec 27 14:12:56.679655 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: python threads support enabled Dec 27 14:12:56.679655 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: your server socket listen backlog is limited to 100 connections Dec 27 14:12:56.679655 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: your mercy for graceful operations on workers is 90 seconds Dec 27 14:12:56.680001 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: mapped 403077 bytes (393 KB) for 2 cores Dec 27 14:12:56.680073 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: *** Operational MODE: preforking *** Dec 27 14:12:56.680342 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: *** uWSGI is running in multiple interpreter mode *** Dec 27 14:12:56.680342 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: spawned uWSGI master process (pid: 101656) Dec 27 14:12:56.680526 dv-cinder-823015-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 27 14:12:56.682781 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: spawned uWSGI worker 1 (pid: 101657, cores: 1) Dec 27 14:12:56.682781 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: spawned uWSGI worker 2 (pid: 101658, cores: 1) Dec 27 14:12:56.682781 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 27 14:12:58.393415 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 27 14:12:58.393415 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: from cryptography.utils import int_from_bytes Dec 27 14:12:58.394044 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 27 14:12:58.394044 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: from cryptography.utils import int_from_bytes Dec 27 14:12:58.397278 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 27 14:12:58.397278 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: from cryptography.utils import int_from_bytes Dec 27 14:12:58.397780 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 27 14:12:58.397780 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: from cryptography.utils import int_from_bytes Dec 27 14:13:00.963466 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 27 14:13:00.964054 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 27 14:13:00.964164 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 27 14:13:00.964164 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 27 14:13:00.964566 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 27 14:13:00.964641 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 27 14:13:00.964707 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 27 14:13:00.964886 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 27 14:13:00.964981 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 27 14:13:00.965133 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 27 14:13:00.965267 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.965519 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.965620 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.965848 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.965935 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.966169 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.966282 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.966496 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.966590 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.966806 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.966900 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.967125 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.967215 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.967443 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.967532 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.967759 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.967884 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.968053 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.968140 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.968361 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.968445 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.968678 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.968775 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-823015-1-iscsi {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.969001 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.969092 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-823015-1-iscsi {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.969312 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.969410 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.969619 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.969710 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.969932 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.970017 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.970238 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.970334 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.970546 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.970629 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.970866 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.970963 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.971181 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.971372 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.971688 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.971827 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.972029 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.972143 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.972340 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.972453 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.972652 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.972796 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.972975 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.973075 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.973291 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.973379 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.973602 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.973689 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.973923 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.974018 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.974232 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.974325 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.974556 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.974642 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.974868 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.975010 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-823015-1-iscsi {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.975261 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-823015-1-iscsi {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.975368 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.975580 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.975681 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.975986 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.976146 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.976383 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.976496 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.976705 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.976792 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.977022 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.977115 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.977347 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.977434 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.977669 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.977761 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.977981 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.978074 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.978292 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.978376 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.978620 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.978705 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.978942 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.979036 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.979261 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.979354 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.979564 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.979648 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.979890 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.979978 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.980206 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.980303 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.980514 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.980599 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.980828 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.980914 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.981133 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.981217 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.981385 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.981476 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.981675 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.981759 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.981984 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.982072 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.982310 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.982405 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.982633 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.982720 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.982891 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.983020 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.983152 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.983243 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.983434 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.983521 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.983754 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.983873 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.984100 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.984194 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.984411 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.984498 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.984721 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.984813 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.985030 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.985125 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.985342 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.985433 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.985650 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.985744 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.985960 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.986051 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.986274 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.986360 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.986584 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.986690 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.986900 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.986984 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.987212 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.987304 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.987526 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.987623 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.987909 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.987999 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.988175 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.988272 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.988507 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.988593 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.988811 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.988934 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.989123 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.989216 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.989459 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.989547 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.989771 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.989862 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.990079 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.990170 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.990400 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.990487 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.990718 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.990802 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.991027 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.991118 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.991335 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.991422 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.992242 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.992342 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.992586 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.992680 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.992900 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.992993 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.993157 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.993243 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.993456 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.993548 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.993763 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.993856 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.994073 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.994158 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.994387 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.994482 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.994695 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.994789 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.995006 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.995098 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.995311 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.995404 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.995614 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.995702 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.995947 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.996036 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.996258 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.996360 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.996638 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.996736 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.996882 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.996974 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.997189 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.997282 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.997494 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.997587 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.997806 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.997931 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.998113 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.998217 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.998420 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.998516 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.998741 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.998849 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.999053 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.999153 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.999362 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.999455 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.999672 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:00.999773 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.000007 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.000104 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.000321 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.000429 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.000634 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.000733 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.000946 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.001045 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.001257 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.001361 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.001572 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.001665 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.001878 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.001973 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.002189 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.002285 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.002497 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.002590 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.002808 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.002909 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.003117 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.003229 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.003422 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.003520 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.003727 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.003820 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.004061 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.004156 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.004374 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.004480 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.004683 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.004776 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.004988 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.005079 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.005291 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.005392 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.005596 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.005693 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.005899 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.005991 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.006203 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.006303 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.006506 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.006605 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.006811 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.006903 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.007111 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.007829 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.008051 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.008263 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.008368 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.008457 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.008673 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.008776 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.008987 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.009087 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.009313 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.009407 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.009635 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:13:01.009729 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.009973 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.010066 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.010308 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.010403 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.010626 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.010728 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.010957 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.011057 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.011294 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.011396 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.011616 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.011716 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.011961 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.012056 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.012281 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.012387 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.012604 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.012698 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.012920 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.013013 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.013235 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.013336 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.013551 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.013643 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.013864 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.014001 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.014184 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.014326 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.014509 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.014637 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.014828 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.014974 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.015145 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.015285 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.015465 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.015606 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.015779 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.015924 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.016117 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.016201 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.016437 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.016511 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.016789 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.016882 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.017306 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.018287 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.018547 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.018688 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.018824 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.018962 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.019099 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.019195 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.019342 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.019470 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.019608 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.019741 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.019941 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.020036 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.020115 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.020237 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.020321 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.020398 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.020569 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.020719 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.020891 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.021065 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.021228 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.021388 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.021549 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.021710 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.021868 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.022054 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.022209 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.022378 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.022529 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.022702 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.022950 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.023186 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.023300 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.023396 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.023615 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.023817 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.023936 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.024164 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.024262 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.024481 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.024574 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.024810 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.024894 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.025146 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.025237 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.025461 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.025578 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.025841 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.025937 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.026156 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.026253 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.026475 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.026566 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.026792 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.026876 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.027103 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.027263 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.027417 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.027500 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.027731 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.027825 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.028064 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.028162 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.028392 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.028486 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.028707 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.028804 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.029015 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.029113 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.029341 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.029427 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.029649 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.029734 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.029956 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.030049 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.030273 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.030364 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.030585 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.030670 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.030900 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.030985 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.031479 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.031582 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.031807 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.031954 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.032145 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.032231 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.032460 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.032552 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.032798 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.032890 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.033132 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.033223 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.033440 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.033523 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.033767 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.033868 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.034096 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.034195 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.034412 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.034500 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.034719 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.034813 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.035030 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.035115 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.035337 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.035419 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.035641 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.035737 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.035972 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.036060 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.036284 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.036367 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.036593 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.036687 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.036898 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.036991 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.037203 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.037296 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.037510 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.037594 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.037812 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.037898 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.038136 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.038226 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.038467 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.038559 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.038775 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.038940 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.039081 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.039257 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.039387 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.039572 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.039733 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.039948 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.040071 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.040265 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.040415 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.040612 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.040750 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.040955 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.041072 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.041283 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.041396 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.041619 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.041703 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.041940 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.042026 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.042263 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.042360 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.042580 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.042663 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.042900 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.042983 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.043213 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.043297 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.043530 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.043612 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.043860 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.043950 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.044185 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.044272 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.044497 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.044581 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.044812 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.044894 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.045122 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.045207 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.045578 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.045780 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.045780 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.045945 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.046055 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.046140 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.046374 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.046463 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.046717 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.046813 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.047035 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.047119 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.047360 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.047455 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.047673 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.047788 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.048015 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.048102 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.048327 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.048412 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.048640 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.048733 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.048952 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.049036 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.049265 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.049350 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.049590 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.049710 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.049902 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.049994 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.050222 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.050311 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.050536 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.050636 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.050846 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.050939 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.051156 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.051249 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.051475 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.051563 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.051782 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.051947 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.052120 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.052206 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.052437 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.052531 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.052769 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.052854 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.053078 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.053175 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.053394 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.053482 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.053710 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.053810 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.054542 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.054702 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.054854 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.054950 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.055167 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.055341 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.055476 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.055666 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.055781 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.056007 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.056103 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.056321 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.056407 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.056639 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.056726 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.056962 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.057050 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.057278 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.057447 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.057594 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.057680 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.057915 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.058004 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.058212 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.058315 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.058515 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.058602 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.058825 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.058909 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.059136 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.059230 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.059449 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.059533 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.059775 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.059917 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.060116 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.060211 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.060420 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.060505 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.060729 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.060827 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.061050 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.061145 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.061358 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.061442 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.061662 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.061747 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.061968 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.062056 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.062274 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.062360 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.062584 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.062675 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.062895 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.062983 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.063210 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.063294 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.063527 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.063614 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.063860 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.063998 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.064170 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.064317 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.064484 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.064579 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.064795 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.064884 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.065105 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.065191 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.065419 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.065515 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.065732 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.065817 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.066042 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.066136 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.066355 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.066450 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.066668 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.066752 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.066978 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.067063 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.067292 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.067386 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.067611 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.067697 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.067942 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.068031 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.068257 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.068357 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.068570 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.068655 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.068873 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.068957 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.069187 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.069276 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.069494 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.069578 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.070042 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.070169 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.070374 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.070513 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.070839 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.070945 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.071161 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.071275 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.071489 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.071585 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.071813 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.071939 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.072170 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.072259 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.072506 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.072593 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.072826 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.072919 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.073137 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.073231 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.073452 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.073538 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.073762 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.073849 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.074070 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.074164 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.074383 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.074469 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.074694 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.074780 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.075003 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.075099 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.075311 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.075395 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.075622 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.075707 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.075949 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.076052 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.076257 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.076345 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.076563 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.076647 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.076873 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.076960 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.077207 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.077302 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.077513 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.077600 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.077828 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.077922 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.078133 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.078266 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.078448 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.078541 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.078757 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.078843 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.079062 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.079157 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.079368 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.079456 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.079676 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.079762 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.080008 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.080096 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.080318 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.080404 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.080663 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.080758 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.080974 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.081072 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.081312 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.081398 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.081622 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.081707 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.081932 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.082022 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.082259 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.082346 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.082565 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.082660 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.082873 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.082961 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.083178 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.083273 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.083485 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.083583 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.083793 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.083936 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.084124 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.084209 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.084434 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.084530 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.084742 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.084829 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.085051 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.085144 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.085881 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.086045 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.086183 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.086271 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.086497 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.086585 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.086805 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.086893 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.087125 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.087211 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.087440 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.087555 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.087751 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.087873 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.088082 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.088169 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.088397 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.088496 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.088702 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.088801 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.089005 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.089096 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.089314 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.089411 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.089619 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.089705 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.089930 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.090037 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.090238 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.090344 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.090544 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.090630 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.090849 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.090933 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.091157 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.091259 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.091463 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.091548 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.091765 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.091868 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.092103 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.092199 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.092411 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.092525 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.092731 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.092815 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.093038 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.093133 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.093345 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.093430 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.093650 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.093735 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.093956 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.094054 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.094266 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.094359 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.094574 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.094661 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.094886 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.094972 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.095192 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.095275 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.095507 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.095600 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.095813 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.095928 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.096139 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.096223 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.096446 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.096555 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.096754 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.096847 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.097056 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.097147 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.097360 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.097468 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.097664 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.097756 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.097977 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.098075 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.098269 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.098379 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.098577 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.098671 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.098883 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.098980 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.099187 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.099279 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.099492 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.099579 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.099799 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.099902 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.100132 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.100274 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.100439 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.100547 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.100787 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.100879 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.101182 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.101268 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.101501 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.101694 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.101817 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.102012 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.102109 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.102334 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.102418 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.102663 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.102772 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.102982 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.103079 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.103300 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.103392 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.103612 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.103695 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.103942 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.104046 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.104248 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.104333 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.104551 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.104636 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.104866 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.104962 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.105174 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.105258 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.105481 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.105565 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.105800 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.105885 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.106113 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.106196 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.106429 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.106520 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.106731 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.106816 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.107041 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.107135 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.107353 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.107438 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.107668 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.107762 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.108006 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.108092 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.108318 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.108401 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.108629 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.108721 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.108943 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.109035 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.109253 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.109346 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.109567 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.109652 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.109878 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.109961 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.110184 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.110328 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.110497 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.110584 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.110805 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.110890 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.111110 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.111270 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.111422 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.111506 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.111735 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.111818 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.112065 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.112167 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.112377 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.112471 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.112683 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.112769 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.112994 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.113078 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.113297 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.113381 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.113604 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.113723 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.113922 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.114041 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.114231 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.114357 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.114658 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.114750 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.114972 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.115065 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.115286 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.115370 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.115594 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.115688 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.115935 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.116034 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.116245 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.116335 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.117147 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.117246 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.117511 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.117595 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.117903 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.117995 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.118274 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.118372 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.118588 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.118682 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.118899 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.118987 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.119215 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.119309 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.119534 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.119619 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.119864 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.119962 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.120171 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.120265 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.120476 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.120564 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.120795 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.120888 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.121100 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.121192 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.121405 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.121505 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.121736 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.121822 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.122045 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.122131 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.122370 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.122461 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.122793 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.122885 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.123117 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.123203 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.123426 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.123509 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.123754 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.123859 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.124104 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.124181 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.126757 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.126908 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.127019 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.127137 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.127251 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.127355 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.127465 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.127568 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.127670 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.127782 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.127952 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.128064 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.128166 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.128268 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.128369 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.128480 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.128591 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.128730 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.128837 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.128947 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.129052 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.129168 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.129256 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.129335 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.129422 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.129502 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.129502 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.129653 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.129729 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.129806 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.129889 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.129966 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.129966 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.130143 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.130231 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.130310 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.130387 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.130504 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.130595 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.130675 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.130765 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.130854 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.130933 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.131067 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.131218 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.131377 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.131543 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.131692 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.131866 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.132028 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.132387 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.132496 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.132721 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.132807 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.133037 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.133122 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.133355 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.133452 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.133664 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.133750 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.133976 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.134060 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.134286 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.134379 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.134596 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.134682 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.134911 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.134995 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.135220 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.135311 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.135543 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.135634 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.135862 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.135962 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.136194 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.136288 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.136505 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.136590 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.136814 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.136896 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.137116 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.137201 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.137423 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.137509 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.137734 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.137818 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.138045 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.138168 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.139881 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.139997 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.139997 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.140126 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.140126 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.140273 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.140348 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.140422 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.140489 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.140576 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.140576 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.140713 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.140713 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.140829 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.140829 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.140960 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.141035 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.141103 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.141168 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.141232 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.141474 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.141599 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.141847 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.142159 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.142285 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.142481 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.142765 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.142938 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.143080 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.143257 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.143388 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.143574 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.143697 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.143985 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.144078 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.144302 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.144390 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.144614 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.144702 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.144919 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.145003 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.145243 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.145329 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.145551 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.145638 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.145876 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.145962 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.146188 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.146273 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.146495 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.146582 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.146799 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.146892 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.147106 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.147193 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.147450 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.147537 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.148350 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.148561 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.148718 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.148866 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.149004 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.149137 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.149295 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.149427 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.149610 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.149778 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.149916 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.150056 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.150240 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.150370 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.150563 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.150700 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.150884 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.151013 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.151201 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.151336 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.151522 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.151662 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.151830 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.151944 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.152171 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.152265 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.152492 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.152617 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.152804 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.152895 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.153125 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.153210 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.153440 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.153525 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.153761 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.153846 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.154304 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.154389 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.154636 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.154724 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.154953 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.155037 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.155268 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.155352 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.155583 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.155668 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.155921 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.156011 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.156495 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.156603 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.156807 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.156892 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.157121 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.157205 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.157433 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.157528 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.157746 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.157832 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.158073 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.158157 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.158399 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.158496 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.158725 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.158829 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.159065 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.159157 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.159380 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.159485 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.159695 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.159783 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.160039 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.160126 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.160356 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.160444 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.160715 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.160803 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.161034 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.161138 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.161342 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.161428 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.161657 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.161748 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.161972 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.162070 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.162287 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.162370 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.162601 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.162698 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.162923 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.163101 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.163230 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.163354 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.164112 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.164238 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.164490 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.164689 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.164771 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.164896 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.165088 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.165216 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.165407 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.165535 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.165738 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.165862 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.166078 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.166198 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.166400 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.166520 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.166715 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.166834 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.167033 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.167130 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.167352 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.167437 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.167897 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.167986 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.168218 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.168314 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.168556 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.168642 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.168886 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.168971 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.169216 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.169311 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.169538 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.169633 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.169855 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.169940 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.170186 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.170281 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.170493 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.170577 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.170801 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.170885 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.171114 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.171201 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.171428 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.171513 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.171737 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.171820 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.172088 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.172182 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.172402 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.172486 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.172710 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.172814 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.173032 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.173155 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.173341 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.173439 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.173875 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.173982 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.174228 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.174326 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.174550 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.174646 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.174880 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.174985 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.175209 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.175306 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.175527 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.175623 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.175857 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.175967 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.176185 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.176282 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.176496 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.176589 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.176804 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.176899 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.177122 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.177211 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.177435 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.177520 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.177738 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.177826 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.178045 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.178143 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.178359 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.178444 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.178670 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.178764 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.178977 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.179076 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.179337 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.179426 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.179653 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.179789 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.180008 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.180109 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.180321 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.180407 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.180632 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.180728 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.180945 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.181030 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.181259 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.181355 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.181567 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.181659 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.181874 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.181981 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.182178 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.182447 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.182545 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.182626 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.182781 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.182882 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.183087 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.183185 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.183398 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.183493 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.183698 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.183787 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.184036 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.184143 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.184342 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.184436 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.184651 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.184738 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.184957 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.185043 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.185279 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.185366 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.185583 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.185669 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.185887 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.185973 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.186198 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.186283 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.186508 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.186594 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.186830 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.186926 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.187143 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.187243 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.187454 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.187539 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.187800 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.187908 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.188143 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.188235 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.188679 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.188779 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.189063 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.189148 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.189387 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.189482 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.189728 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.189893 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.190068 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.190157 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.190376 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.190462 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.190683 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.190778 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.190989 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.191085 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.191315 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.191399 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.191625 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.191720 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.191962 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.192064 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.192273 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.192359 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.192582 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.192670 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.192890 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.192977 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.193201 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.193285 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.193509 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.193597 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.193818 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.193903 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.194125 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.194211 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.194440 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.194529 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.194864 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.194954 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.195190 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.195287 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.195516 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.195603 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.195851 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.195940 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.196187 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.196286 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.196502 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.196589 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.196819 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.196904 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.197128 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.197288 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.197440 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.197529 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.197758 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.197853 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.198091 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.198202 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.198404 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.198500 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.198709 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.198794 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.199127 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.199215 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.199441 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.199532 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.199757 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.199903 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.200108 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.200198 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.200421 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.200516 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.200743 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.200831 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.201069 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.201156 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.201381 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.201468 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.201769 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.201921 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.202023 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.202110 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.202329 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.202430 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.202666 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.202767 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.202996 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.203081 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.203317 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.203403 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.203624 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.203717 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.203955 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.204048 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.204262 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.204350 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.204574 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.204662 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.204903 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.204996 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.205236 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.205331 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.205549 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.205644 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.205873 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.205967 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.206186 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.206280 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.206506 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.206600 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.206817 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.206903 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.207137 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.207230 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.207459 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.207555 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.207775 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.207877 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.208114 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.208212 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.208445 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.208534 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.208774 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.208868 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.209070 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.209165 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.209384 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.209478 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.209695 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.209787 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.210004 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.210100 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.210825 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.210959 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.211163 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.211278 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.211494 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.211583 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.211799 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.211906 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.212147 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.212246 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.212469 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.212568 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.212783 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.212921 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.213100 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.213193 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.213415 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.213547 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.213744 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.213832 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.214061 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.214169 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.214375 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.214464 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.214688 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.214780 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.214999 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.215094 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.215317 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.215401 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.215632 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.215730 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.215982 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.216088 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.216311 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.216398 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.216635 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.216720 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.216963 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.217049 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.217306 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.217400 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.217620 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.217709 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.217964 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.218057 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.218291 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.218379 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.218606 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.218692 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.218919 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.219005 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.219224 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.219309 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:13:01.219465 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 27 14:13:01.219552 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 27 14:13:01.242645 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_db.sqlalchemy.engines [None req-9abd6cd8-13e5-42e7-997b-304d892dcc65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101657) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 27 14:13:01.243940 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG oslo_db.sqlalchemy.engines [None req-e0565c4d-de1a-4b53-af74-5c474300f649 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 27 14:13:01.308307 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.context [None req-9abd6cd8-13e5-42e7-997b-304d892dcc65 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5(cell1) {{(pid=101657) load_cells /opt/stack/nova/nova/context.py:464}} Dec 27 14:13:01.309246 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.context [None req-e0565c4d-de1a-4b53-af74-5c474300f649 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5(cell1) {{(pid=101658) load_cells /opt/stack/nova/nova/context.py:464}} Dec 27 14:13:01.312551 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_concurrency.lockutils [None req-9abd6cd8-13e5-42e7-997b-304d892dcc65 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:13:01.313462 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-e0565c4d-de1a-4b53-af74-5c474300f649 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:13:01.314157 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_concurrency.lockutils [None req-9abd6cd8-13e5-42e7-997b-304d892dcc65 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:13:01.314965 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_concurrency.lockutils [None req-9abd6cd8-13e5-42e7-997b-304d892dcc65 None None] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:13:01.315070 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-e0565c4d-de1a-4b53-af74-5c474300f649 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:13:01.315882 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-e0565c4d-de1a-4b53-af74-5c474300f649 None None] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:13:01.316929 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_concurrency.lockutils [None req-9abd6cd8-13e5-42e7-997b-304d892dcc65 None None] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:13:01.317820 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG oslo_concurrency.lockutils [None req-e0565c4d-de1a-4b53-af74-5c474300f649 None None] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:13:01.328888 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_db.sqlalchemy.engines [None req-9abd6cd8-13e5-42e7-997b-304d892dcc65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101657) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 27 14:13:01.331279 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_db.sqlalchemy.engines [None req-9abd6cd8-13e5-42e7-997b-304d892dcc65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101657) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 27 14:13:01.335225 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG oslo_db.sqlalchemy.engines [None req-e0565c4d-de1a-4b53-af74-5c474300f649 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 27 14:13:01.338334 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG oslo_db.sqlalchemy.engines [None req-e0565c4d-de1a-4b53-af74-5c474300f649 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 27 14:13:01.500392 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_db.sqlalchemy.engines [None req-9abd6cd8-13e5-42e7-997b-304d892dcc65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101657) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 27 14:13:01.502958 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG oslo_db.sqlalchemy.engines [None req-e0565c4d-de1a-4b53-af74-5c474300f649 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 27 14:13:01.840311 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: WARNING keystonemiddleware.auth_token [None req-e0565c4d-de1a-4b53-af74-5c474300f649 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 27 14:13:01.846586 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: WARNING keystonemiddleware.auth_token [None req-9abd6cd8-13e5-42e7-997b-304d892dcc65 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 27 14:13:01.846797 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: WARNING keystonemiddleware.auth_token [None req-e0565c4d-de1a-4b53-af74-5c474300f649 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 27 14:13:01.853326 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: WARNING keystonemiddleware.auth_token [None req-9abd6cd8-13e5-42e7-997b-304d892dcc65 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 27 14:13:02.184119 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: WARNING keystonemiddleware.auth_token [None req-e0565c4d-de1a-4b53-af74-5c474300f649 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 27 14:13:02.189370 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: WARNING keystonemiddleware.auth_token [None req-e0565c4d-de1a-4b53-af74-5c474300f649 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 27 14:13:02.192922 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: WARNING keystonemiddleware.auth_token [None req-9abd6cd8-13e5-42e7-997b-304d892dcc65 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 27 14:13:02.194447 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f505fad9c0 pid: 101658 (default app) Dec 27 14:13:02.196631 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-e0565c4d-de1a-4b53-af74-5c474300f649 None None] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:13:02.197801 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-e0565c4d-de1a-4b53-af74-5c474300f649 None None] 10.222.0.37 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001726 Dec 27 14:13:02.198215 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 1/1] 10.222.0.37 () {50 vars in 788 bytes} [Mon Dec 27 14:13:02 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:13:02.198442 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: WARNING keystonemiddleware.auth_token [None req-9abd6cd8-13e5-42e7-997b-304d892dcc65 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 27 14:13:02.203642 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f505fad9c0 pid: 101657 (default app) Dec 27 14:14:29.589496 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-e0565c4d-de1a-4b53-af74-5c474300f649 None None] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:14:29.590538 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-e0565c4d-de1a-4b53-af74-5c474300f649 None None] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Dec 27 14:14:29.591125 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 2/2] 10.222.0.37 () {54 vars in 930 bytes} [Mon Dec 27 14:14:29 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:14:30.008370 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-29567c88-0a90-4d13-8276-05abab22872c admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:14:30.039084 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-29567c88-0a90-4d13-8276-05abab22872c admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.439698 Dec 27 14:14:30.039751 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 1/3] 10.222.0.37 () {60 vars in 1291 bytes} [Mon Dec 27 14:14:29 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:14:32.465316 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-e0565c4d-de1a-4b53-af74-5c474300f649 None None] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:14:32.466328 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-e0565c4d-de1a-4b53-af74-5c474300f649 None None] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Dec 27 14:14:32.466729 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 3/4] 10.222.0.37 () {54 vars in 930 bytes} [Mon Dec 27 14:14:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:14:32.527465 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-ce12debb-e455-42c0-855e-c87c4684d535 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "name": "cirros256", "disk": 1, "os-flavor-access:is_public": true, "ram": 256}} {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:14:32.547088 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:14:32.547088 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: warnings.warn(msg) Dec 27 14:14:32.577298 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-ce12debb-e455-42c0-855e-c87c4684d535 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103688 Dec 27 14:14:32.579007 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 2/5] 10.222.0.37 () {64 vars in 1282 bytes} [Mon Dec 27 14:14:32 2021] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:14:32.796696 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-f71de3fa-0a68-4a3c-8fdb-9dbfa61a3ae1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:14:32.798985 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:14:32.798985 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: warnings.warn(msg) Dec 27 14:14:32.846112 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-f71de3fa-0a68-4a3c-8fdb-9dbfa61a3ae1 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.258985 Dec 27 14:14:32.847407 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 4/6] 10.222.0.37 () {64 vars in 1335 bytes} [Mon Dec 27 14:14:32 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:14:35.258920 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-ce12debb-e455-42c0-855e-c87c4684d535 admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:14:35.260026 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-ce12debb-e455-42c0-855e-c87c4684d535 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Dec 27 14:14:35.260447 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 3/7] 10.222.0.37 () {54 vars in 930 bytes} [Mon Dec 27 14:14:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:14:35.390666 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-8c1d9c8f-ec16-4d9e-9a04-b77aa08380ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "swap": 0, "name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:14:35.411510 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:14:35.411510 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: warnings.warn(msg) Dec 27 14:14:35.431370 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-8c1d9c8f-ec16-4d9e-9a04-b77aa08380ce admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.163986 Dec 27 14:14:35.432274 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 5/8] 10.222.0.37 () {64 vars in 1282 bytes} [Mon Dec 27 14:14:35 2021] POST /compute/v2.1/flavors => generated 404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:14:35.444810 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-fd48b820-4a0b-4951-9045-fbb94b4bd970 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:14:35.446295 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:14:35.446295 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: warnings.warn(msg) Dec 27 14:14:35.484058 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-fd48b820-4a0b-4951-9045-fbb94b4bd970 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043611 Dec 27 14:14:35.485276 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 4/9] 10.222.0.37 () {64 vars in 1335 bytes} [Mon Dec 27 14:14:35 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:14:37.975251 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-8c1d9c8f-ec16-4d9e-9a04-b77aa08380ce admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:14:37.976359 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-8c1d9c8f-ec16-4d9e-9a04-b77aa08380ce admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Dec 27 14:14:37.976934 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 6/10] 10.222.0.37 () {54 vars in 930 bytes} [Mon Dec 27 14:14:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:14:38.037434 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-6f747ca5-c4a6-4343-b5f9-fb45bc1c664e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G", "swap": 0, "id": "d2", "ram": 1024, "disk": 10, "rxtx_factor": 1.0}} {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:14:38.056848 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-6f747ca5-c4a6-4343-b5f9-fb45bc1c664e admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073975 Dec 27 14:14:38.064513 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 5/11] 10.222.0.37 () {64 vars in 1282 bytes} [Mon Dec 27 14:14:37 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:14:38.069908 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-112f65e6-c9f9-46fc-98a3-afd2ba114d97 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:14:38.093204 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-112f65e6-c9f9-46fc-98a3-afd2ba114d97 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027151 Dec 27 14:14:38.093934 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 7/12] 10.222.0.37 () {64 vars in 1335 bytes} [Mon Dec 27 14:14:38 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:14:40.541583 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-6f747ca5-c4a6-4343-b5f9-fb45bc1c664e admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:14:40.542692 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-6f747ca5-c4a6-4343-b5f9-fb45bc1c664e admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Dec 27 14:14:40.543161 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 6/13] 10.222.0.37 () {54 vars in 930 bytes} [Mon Dec 27 14:14:40 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:14:40.601406 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-f278b6d5-6132-43bc-b5b9-25a9b60c7368 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "name": "ds2G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "disk": 10}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:14:40.619338 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-f278b6d5-6132-43bc-b5b9-25a9b60c7368 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.069965 Dec 27 14:14:40.620084 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 8/14] 10.222.0.37 () {64 vars in 1282 bytes} [Mon Dec 27 14:14:40 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:14:40.632084 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-23b0724e-c09a-4aaf-b8d6-f46afc00623c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:14:40.654083 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-23b0724e-c09a-4aaf-b8d6-f46afc00623c admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025628 Dec 27 14:14:40.654635 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 7/15] 10.222.0.37 () {64 vars in 1335 bytes} [Mon Dec 27 14:14:40 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:14:43.127083 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-f278b6d5-6132-43bc-b5b9-25a9b60c7368 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:14:43.129413 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-f278b6d5-6132-43bc-b5b9-25a9b60c7368 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002748 Dec 27 14:14:43.130944 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 9/16] 10.222.0.37 () {54 vars in 930 bytes} [Mon Dec 27 14:14:43 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:14:43.190653 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-78db47a5-d5e8-4e0c-b3e2-d128b1371f1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "vcpus": 4, "rxtx_factor": 1.0, "swap": 0}} {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:14:43.210914 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-78db47a5-d5e8-4e0c-b3e2-d128b1371f1c admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074210 Dec 27 14:14:43.219165 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 8/17] 10.222.0.37 () {64 vars in 1282 bytes} [Mon Dec 27 14:14:43 2021] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:14:43.225640 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-8c0e8549-6e39-45c3-a3ae-441fdd8ac769 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:14:43.248585 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-8c0e8549-6e39-45c3-a3ae-441fdd8ac769 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028186 Dec 27 14:14:43.249278 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 10/18] 10.222.0.37 () {64 vars in 1335 bytes} [Mon Dec 27 14:14:43 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:14:45.657710 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-78db47a5-d5e8-4e0c-b3e2-d128b1371f1c admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:14:45.658803 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-78db47a5-d5e8-4e0c-b3e2-d128b1371f1c admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Dec 27 14:14:45.659203 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 9/19] 10.222.0.37 () {54 vars in 930 bytes} [Mon Dec 27 14:14:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:14:45.723274 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-183cb40a-95f8-48fa-91ce-72d90e23a269 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:14:45.750227 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-183cb40a-95f8-48fa-91ce-72d90e23a269 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084515 Dec 27 14:14:45.750770 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 11/20] 10.222.0.37 () {60 vars in 1291 bytes} [Mon Dec 27 14:14:45 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:14:48.250321 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-78db47a5-d5e8-4e0c-b3e2-d128b1371f1c admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:14:48.251926 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-78db47a5-d5e8-4e0c-b3e2-d128b1371f1c admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002041 Dec 27 14:14:48.253286 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 10/21] 10.222.0.37 () {54 vars in 930 bytes} [Mon Dec 27 14:14:48 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:14:48.317747 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-2eac493b-6b6a-4d61-acac-3fa4cb9688b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "disk": 1, "swap": 0, "name": "m1.tiny", "vcpus": 1, "id": "1"}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:14:48.337101 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-2eac493b-6b6a-4d61-acac-3fa4cb9688b5 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076999 Dec 27 14:14:48.337663 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 12/22] 10.222.0.37 () {64 vars in 1282 bytes} [Mon Dec 27 14:14:48 2021] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:14:48.350627 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-859fb7a7-a0f7-4c53-ab63-c24cab34af5c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:14:48.376988 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-859fb7a7-a0f7-4c53-ab63-c24cab34af5c admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030795 Dec 27 14:14:48.384908 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 11/23] 10.222.0.37 () {64 vars in 1332 bytes} [Mon Dec 27 14:14:48 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:14:50.817015 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-2eac493b-6b6a-4d61-acac-3fa4cb9688b5 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:14:50.818083 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-2eac493b-6b6a-4d61-acac-3fa4cb9688b5 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Dec 27 14:14:50.818485 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 13/24] 10.222.0.37 () {54 vars in 930 bytes} [Mon Dec 27 14:14:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:14:50.881601 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-2f8d68cc-b49a-4151-9434-5a6cd609f541 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.small", "ram": 2048, "id": "2"}} {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:14:50.907636 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-2f8d68cc-b49a-4151-9434-5a6cd609f541 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.081017 Dec 27 14:14:50.911914 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 12/25] 10.222.0.37 () {64 vars in 1282 bytes} [Mon Dec 27 14:14:50 2021] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:14:50.923065 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-8915b502-f7e4-43a5-9f57-f2a9c8cf3c28 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:14:50.947591 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-8915b502-f7e4-43a5-9f57-f2a9c8cf3c28 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028935 Dec 27 14:14:50.948366 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 14/26] 10.222.0.37 () {64 vars in 1332 bytes} [Mon Dec 27 14:14:50 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:14:53.771164 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-2f8d68cc-b49a-4151-9434-5a6cd609f541 admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:14:53.772221 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-2f8d68cc-b49a-4151-9434-5a6cd609f541 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Dec 27 14:14:53.772615 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 13/27] 10.222.0.37 () {54 vars in 930 bytes} [Mon Dec 27 14:14:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:14:53.856623 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-d3fae53a-3a6a-4fb5-9ca7-1a6fcdf15862 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "disk": 40, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:14:53.879388 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-d3fae53a-3a6a-4fb5-9ca7-1a6fcdf15862 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.099433 Dec 27 14:14:53.880200 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 15/28] 10.222.0.37 () {64 vars in 1282 bytes} [Mon Dec 27 14:14:53 2021] POST /compute/v2.1/flavors => generated 406 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:14:53.892399 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-5d6ef0cb-03dd-4765-a33f-0cdf042d3bce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:14:53.919630 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-5d6ef0cb-03dd-4765-a33f-0cdf042d3bce admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030832 Dec 27 14:14:53.920361 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 14/29] 10.222.0.37 () {64 vars in 1332 bytes} [Mon Dec 27 14:14:53 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:14:56.418512 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-d3fae53a-3a6a-4fb5-9ca7-1a6fcdf15862 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:14:56.419517 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-d3fae53a-3a6a-4fb5-9ca7-1a6fcdf15862 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Dec 27 14:14:56.419937 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 16/30] 10.222.0.37 () {54 vars in 930 bytes} [Mon Dec 27 14:14:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:14:56.478313 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-ff39a12d-68e0-45d4-8054-dc4325ff8eae admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.large", "disk": 80, "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:14:56.496415 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-ff39a12d-68e0-45d4-8054-dc4325ff8eae admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069529 Dec 27 14:14:56.496968 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 15/31] 10.222.0.37 () {64 vars in 1282 bytes} [Mon Dec 27 14:14:56 2021] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:14:56.509681 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-f397e5fb-1784-43e1-a2a4-2939616821dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:14:56.531612 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-f397e5fb-1784-43e1-a2a4-2939616821dd admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025511 Dec 27 14:14:56.532221 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 17/32] 10.222.0.37 () {64 vars in 1332 bytes} [Mon Dec 27 14:14:56 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:14:58.943540 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-ff39a12d-68e0-45d4-8054-dc4325ff8eae admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:14:58.944533 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-ff39a12d-68e0-45d4-8054-dc4325ff8eae admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Dec 27 14:14:58.944933 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 16/33] 10.222.0.37 () {54 vars in 930 bytes} [Mon Dec 27 14:14:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:14:59.004084 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-f3e96b93-b5ed-45b6-bf12-94cbdb9cc0d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "id": "5"}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:14:59.021764 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-f3e96b93-b5ed-45b6-bf12-94cbdb9cc0d5 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.070503 Dec 27 14:14:59.022963 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 18/34] 10.222.0.37 () {64 vars in 1282 bytes} [Mon Dec 27 14:14:58 2021] POST /compute/v2.1/flavors => generated 408 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:14:59.035597 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-5342ab5d-8884-4a4c-9e11-5c48cdc9fc02 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:14:59.058090 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-5342ab5d-8884-4a4c-9e11-5c48cdc9fc02 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026521 Dec 27 14:14:59.058656 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 17/35] 10.222.0.37 () {64 vars in 1332 bytes} [Mon Dec 27 14:14:59 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:15:24.832278 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-f3e96b93-b5ed-45b6-bf12-94cbdb9cc0d5 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:15:24.833310 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-f3e96b93-b5ed-45b6-bf12-94cbdb9cc0d5 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Dec 27 14:15:24.833702 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 19/36] 10.222.0.37 () {54 vars in 930 bytes} [Mon Dec 27 14:15:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:15:24.889751 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-7a51e5b4-ef46-47d7-894c-1d20fe1a5f4b admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:15:24.907350 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-7a51e5b4-ef46-47d7-894c-1d20fe1a5f4b admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067453 Dec 27 14:15:24.908456 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 18/37] 10.222.0.37 () {60 vars in 1291 bytes} [Mon Dec 27 14:15:24 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:15:26.491079 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-f3e96b93-b5ed-45b6-bf12-94cbdb9cc0d5 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:15:26.492103 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-f3e96b93-b5ed-45b6-bf12-94cbdb9cc0d5 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Dec 27 14:15:26.492506 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 20/38] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Dec 27 14:15:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:15:26.682319 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-e959e27e-f0bb-4ac9-be54-7b7e02077651 admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:15:26.687899 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.wsgi [None req-e959e27e-f0bb-4ac9-be54-7b7e02077651 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 27 14:15:26.688474 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-e959e27e-f0bb-4ac9-be54-7b7e02077651 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:15:26.689970 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-e959e27e-f0bb-4ac9-be54-7b7e02077651 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059060 Dec 27 14:15:26.690476 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 19/39] 10.222.0.37 () {60 vars in 1190 bytes} [Mon Dec 27 14:15:26 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 27 14:15:26.700463 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-2e26095d-f682-46dd-b49f-62554f8cc868 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:15:26.721370 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-2e26095d-f682-46dd-b49f-62554f8cc868 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024571 Dec 27 14:15:26.721914 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 21/40] 10.222.0.37 () {60 vars in 1210 bytes} [Mon Dec 27 14:15:26 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:15:26.731865 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-78e9bddd-be42-46ba-be62-6ed643ea40ee admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:15:26.752670 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-78e9bddd-be42-46ba-be62-6ed643ea40ee admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024250 Dec 27 14:15:26.753190 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 20/41] 10.222.0.37 () {60 vars in 1210 bytes} [Mon Dec 27 14:15:26 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:15:26.762792 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-32639cf8-af90-43d9-8ec3-cd471e7c34b0 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:15:26.768681 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.wsgi [None req-32639cf8-af90-43d9-8ec3-cd471e7c34b0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 27 14:15:26.769239 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-32639cf8-af90-43d9-8ec3-cd471e7c34b0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:15:26.770016 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-32639cf8-af90-43d9-8ec3-cd471e7c34b0 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010675 Dec 27 14:15:26.770500 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 22/42] 10.222.0.37 () {60 vars in 1190 bytes} [Mon Dec 27 14:15:26 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Dec 27 14:15:28.249821 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-78e9bddd-be42-46ba-be62-6ed643ea40ee admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:15:28.250818 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-78e9bddd-be42-46ba-be62-6ed643ea40ee admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Dec 27 14:15:28.251257 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 21/43] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Dec 27 14:15:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:15:28.440561 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-96a4129e-216c-4778-94c3-d64caaa4f342 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:15:28.445711 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.wsgi [None req-96a4129e-216c-4778-94c3-d64caaa4f342 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 27 14:15:28.446270 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-96a4129e-216c-4778-94c3-d64caaa4f342 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:15:28.447049 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-96a4129e-216c-4778-94c3-d64caaa4f342 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058450 Dec 27 14:15:28.447550 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 23/44] 10.222.0.37 () {60 vars in 1190 bytes} [Mon Dec 27 14:15:28 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 27 14:15:28.457817 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-ea68de52-03cd-4b67-8459-4bd19cda4686 admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:15:28.471437 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-ea68de52-03cd-4b67-8459-4bd19cda4686 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017659 Dec 27 14:15:28.472018 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 22/45] 10.222.0.37 () {60 vars in 1210 bytes} [Mon Dec 27 14:15:28 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:15:28.481458 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-63ede295-801c-47f7-a133-1715185aa1aa admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:15:28.494624 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-63ede295-801c-47f7-a133-1715185aa1aa admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016468 Dec 27 14:15:28.495134 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 24/46] 10.222.0.37 () {60 vars in 1210 bytes} [Mon Dec 27 14:15:28 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:15:28.504565 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-394b15ef-168f-4abc-86eb-37d0e45e37c9 admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:15:28.509554 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.wsgi [None req-394b15ef-168f-4abc-86eb-37d0e45e37c9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 27 14:15:28.510113 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-394b15ef-168f-4abc-86eb-37d0e45e37c9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:15:28.510879 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-394b15ef-168f-4abc-86eb-37d0e45e37c9 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009849 Dec 27 14:15:28.511357 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 23/47] 10.222.0.37 () {60 vars in 1190 bytes} [Mon Dec 27 14:15:28 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 27 14:15:29.998826 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-63ede295-801c-47f7-a133-1715185aa1aa admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:15:29.999826 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-63ede295-801c-47f7-a133-1715185aa1aa admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Dec 27 14:15:30.000243 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 25/48] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Dec 27 14:15:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:15:30.192101 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-152fd2c2-97e3-4923-9ff9-059eeb14230b admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:15:30.197264 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.wsgi [None req-152fd2c2-97e3-4923-9ff9-059eeb14230b admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 27 14:15:30.197828 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-152fd2c2-97e3-4923-9ff9-059eeb14230b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:15:30.198615 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-152fd2c2-97e3-4923-9ff9-059eeb14230b admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058203 Dec 27 14:15:30.199117 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 24/49] 10.222.0.37 () {60 vars in 1193 bytes} [Mon Dec 27 14:15:30 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 27 14:15:30.208875 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-d8e952cd-a47f-4566-b738-e477f9190c77 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:15:30.222254 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-d8e952cd-a47f-4566-b738-e477f9190c77 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016966 Dec 27 14:15:30.222765 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 26/50] 10.222.0.37 () {60 vars in 1210 bytes} [Mon Dec 27 14:15:30 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:15:30.233939 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-b5a10ae7-8400-4dc2-89ed-1f69ab5d1886 admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:15:30.247317 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-b5a10ae7-8400-4dc2-89ed-1f69ab5d1886 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018329 Dec 27 14:15:30.247847 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 25/51] 10.222.0.37 () {60 vars in 1210 bytes} [Mon Dec 27 14:15:30 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:15:30.257767 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-d4d7a16e-84e9-4144-8cf7-ee5960b2b89a admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:15:30.262863 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.wsgi [None req-d4d7a16e-84e9-4144-8cf7-ee5960b2b89a admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 27 14:15:30.263420 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-d4d7a16e-84e9-4144-8cf7-ee5960b2b89a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:15:30.264228 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-d4d7a16e-84e9-4144-8cf7-ee5960b2b89a admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009871 Dec 27 14:15:30.264709 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 27/52] 10.222.0.37 () {60 vars in 1193 bytes} [Mon Dec 27 14:15:30 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 27 14:15:31.738305 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-b5a10ae7-8400-4dc2-89ed-1f69ab5d1886 admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:15:31.739309 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-b5a10ae7-8400-4dc2-89ed-1f69ab5d1886 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Dec 27 14:15:31.739721 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 26/53] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Dec 27 14:15:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:15:31.930059 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-68462288-b332-4d59-928c-61619dda041a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:15:31.948432 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-68462288-b332-4d59-928c-61619dda041a admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069942 Dec 27 14:15:31.948889 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 28/54] 10.222.0.37 () {64 vars in 1235 bytes} [Mon Dec 27 14:15:31 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:15:33.437863 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-b5a10ae7-8400-4dc2-89ed-1f69ab5d1886 admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:15:33.439749 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-b5a10ae7-8400-4dc2-89ed-1f69ab5d1886 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002013 Dec 27 14:15:33.440199 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 27/55] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Dec 27 14:15:33 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:15:33.631217 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-b60b3a57-68cb-44e7-8697-636fb60804ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:15:33.648780 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-b60b3a57-68cb-44e7-8697-636fb60804ca admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069409 Dec 27 14:15:33.649253 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 29/56] 10.222.0.37 () {64 vars in 1235 bytes} [Mon Dec 27 14:15:33 2021] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:15:35.128739 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-b5a10ae7-8400-4dc2-89ed-1f69ab5d1886 admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:15:35.129750 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-b5a10ae7-8400-4dc2-89ed-1f69ab5d1886 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Dec 27 14:15:35.130151 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 28/57] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Dec 27 14:15:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:15:35.321264 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-2ca7c68c-45c6-4db9-a953-7ce0466b9609 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:15:35.339458 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-2ca7c68c-45c6-4db9-a953-7ce0466b9609 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069846 Dec 27 14:15:35.339956 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 30/58] 10.222.0.37 () {64 vars in 1235 bytes} [Mon Dec 27 14:15:35 2021] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:15:36.843353 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-b5a10ae7-8400-4dc2-89ed-1f69ab5d1886 admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:15:36.844398 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-b5a10ae7-8400-4dc2-89ed-1f69ab5d1886 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Dec 27 14:15:36.845453 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 29/59] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Dec 27 14:15:36 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:15:37.034627 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-f8e5ac84-b512-4d76-80d9-65ab553184c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:15:37.051954 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-f8e5ac84-b512-4d76-80d9-65ab553184c7 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068567 Dec 27 14:15:37.052496 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 31/60] 10.222.0.37 () {64 vars in 1235 bytes} [Mon Dec 27 14:15:36 2021] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:15:38.538415 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-b5a10ae7-8400-4dc2-89ed-1f69ab5d1886 admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:15:38.539402 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-b5a10ae7-8400-4dc2-89ed-1f69ab5d1886 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 Dec 27 14:15:38.539790 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 30/61] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Dec 27 14:15:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:15:38.728719 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-db997a81-5379-462d-965c-96ac465979a4 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:15:38.747946 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-db997a81-5379-462d-965c-96ac465979a4 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069487 Dec 27 14:15:38.748417 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 32/62] 10.222.0.37 () {60 vars in 1202 bytes} [Mon Dec 27 14:15:38 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:16:26.239522 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-b5a10ae7-8400-4dc2-89ed-1f69ab5d1886 admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:16:26.240553 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-b5a10ae7-8400-4dc2-89ed-1f69ab5d1886 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Dec 27 14:16:26.240941 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 31/63] 10.222.0.37 () {54 vars in 930 bytes} [Mon Dec 27 14:16:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:16:26.298809 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-8e15c058-1a31-4867-a372-94fb9387bff2 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:16:26.317442 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-8e15c058-1a31-4867-a372-94fb9387bff2 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070310 Dec 27 14:16:26.317974 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 33/64] 10.222.0.37 () {60 vars in 1291 bytes} [Mon Dec 27 14:16:26 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:16:26.339552 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-0c78d3f9-a42b-4b04-ab37-b3a4f3d4d62b admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:16:26.347634 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-0c78d3f9-a42b-4b04-ab37-b3a4f3d4d62b admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011647 Dec 27 14:16:26.348194 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 32/65] 10.222.0.37 () {60 vars in 1282 bytes} [Mon Dec 27 14:16:26 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:16:26.361047 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-175ff11d-5204-477a-b918-afce158c4da1 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:16:26.368496 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-175ff11d-5204-477a-b918-afce158c4da1 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011704 Dec 27 14:16:26.369002 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 34/66] 10.222.0.37 () {60 vars in 1285 bytes} [Mon Dec 27 14:16:26 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:16:26.381375 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-16dee95a-11e2-4e92-b860-ef27e897a5ac admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:16:26.388754 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-16dee95a-11e2-4e92-b860-ef27e897a5ac admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010803 Dec 27 14:16:26.389265 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 33/67] 10.222.0.37 () {60 vars in 1285 bytes} [Mon Dec 27 14:16:26 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:16:26.400587 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-ac961c8f-827e-4a35-9f40-fde562620cb9 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:16:26.408860 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-ac961c8f-827e-4a35-9f40-fde562620cb9 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011684 Dec 27 14:16:26.409378 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 35/68] 10.222.0.37 () {60 vars in 1282 bytes} [Mon Dec 27 14:16:26 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:17:54.180110 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-90b619c1-00f7-489d-b3f6-a376c67ea8f1 tempest-verify_tempest_config-844122909 tempest-verify_tempest_config-844122909-project] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:17:54.182046 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-90b619c1-00f7-489d-b3f6-a376c67ea8f1 tempest-verify_tempest_config-844122909 tempest-verify_tempest_config-844122909-project] 10.222.0.37 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.109746 Dec 27 14:17:54.182569 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 34/69] 10.222.0.37 () {58 vars in 1133 bytes} [Mon Dec 27 14:17:54 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:19:18.740349 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-ac961c8f-827e-4a35-9f40-fde562620cb9 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:19:18.741359 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-ac961c8f-827e-4a35-9f40-fde562620cb9 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Dec 27 14:19:18.741754 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 36/70] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Dec 27 14:19:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:19:19.002972 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-872b5389-8488-43c2-a86a-1935746b6aa5 admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:19:19.003910 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:19:19.003910 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: warnings.warn(msg) Dec 27 14:19:19.005453 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_concurrency.lockutils [None req-872b5389-8488-43c2-a86a-1935746b6aa5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:19:19.005901 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_concurrency.lockutils [None req-872b5389-8488-43c2-a86a-1935746b6aa5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:19:19.006766 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_concurrency.lockutils [None req-872b5389-8488-43c2-a86a-1935746b6aa5 admin admin] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:19:19.007197 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_concurrency.lockutils [None req-872b5389-8488-43c2-a86a-1935746b6aa5 admin admin] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:19:19.044371 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-872b5389-8488-43c2-a86a-1935746b6aa5 admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.157736 Dec 27 14:19:19.044954 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 35/71] 10.222.0.37 () {60 vars in 1193 bytes} [Mon Dec 27 14:19:18 2021] GET /compute/v2.1/os-services => generated 791 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:19:20.558730 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-ac961c8f-827e-4a35-9f40-fde562620cb9 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:19:20.559741 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-ac961c8f-827e-4a35-9f40-fde562620cb9 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Dec 27 14:19:20.560162 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 37/72] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Dec 27 14:19:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:19:20.752357 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-87a8a428-346c-4f09-a6eb-3f0d6acd88e7 admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:19:20.753509 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:19:20.753509 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: warnings.warn(msg) Dec 27 14:19:20.755013 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_concurrency.lockutils [None req-87a8a428-346c-4f09-a6eb-3f0d6acd88e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:19:20.755456 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_concurrency.lockutils [None req-87a8a428-346c-4f09-a6eb-3f0d6acd88e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:19:20.756288 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_concurrency.lockutils [None req-87a8a428-346c-4f09-a6eb-3f0d6acd88e7 admin admin] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:19:20.756742 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_concurrency.lockutils [None req-87a8a428-346c-4f09-a6eb-3f0d6acd88e7 admin admin] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:19:20.776591 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-87a8a428-346c-4f09-a6eb-3f0d6acd88e7 admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074737 Dec 27 14:19:20.777069 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 36/73] 10.222.0.37 () {60 vars in 1193 bytes} [Mon Dec 27 14:19:20 2021] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:19:32.708005 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-ac961c8f-827e-4a35-9f40-fde562620cb9 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:19:32.708999 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-ac961c8f-827e-4a35-9f40-fde562620cb9 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Dec 27 14:19:32.709386 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 38/74] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Dec 27 14:19:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:19:32.903438 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-21925713-8dc0-407e-97de-63192ebe3839 admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:19:32.904625 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:19:32.904625 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: warnings.warn(msg) Dec 27 14:19:32.906131 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_concurrency.lockutils [None req-21925713-8dc0-407e-97de-63192ebe3839 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:19:32.906579 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_concurrency.lockutils [None req-21925713-8dc0-407e-97de-63192ebe3839 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:19:32.907638 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_concurrency.lockutils [None req-21925713-8dc0-407e-97de-63192ebe3839 admin admin] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:19:32.908105 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_concurrency.lockutils [None req-21925713-8dc0-407e-97de-63192ebe3839 admin admin] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:19:32.932465 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-21925713-8dc0-407e-97de-63192ebe3839 admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080295 Dec 27 14:19:32.932949 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 37/75] 10.222.0.37 () {60 vars in 1193 bytes} [Mon Dec 27 14:19:32 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:19:34.441604 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: DEBUG nova.api.openstack.wsgi [None req-ac961c8f-827e-4a35-9f40-fde562620cb9 admin admin] Calling method '>' {{(pid=101658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:19:34.442614 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: INFO nova.api.openstack.requestlog [None req-ac961c8f-827e-4a35-9f40-fde562620cb9 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Dec 27 14:19:34.443044 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: [pid: 101658|app: 0|req: 39/76] 10.222.0.37 () {56 vars in 1074 bytes} [Mon Dec 27 14:19:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:19:34.637454 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG nova.api.openstack.wsgi [None req-0df1998f-488c-4120-87fb-c671fd4e4363 admin admin] Calling method '>' {{(pid=101657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:19:34.638615 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:19:34.638615 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: warnings.warn(msg) Dec 27 14:19:34.640176 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_concurrency.lockutils [None req-0df1998f-488c-4120-87fb-c671fd4e4363 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:19:34.640653 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_concurrency.lockutils [None req-0df1998f-488c-4120-87fb-c671fd4e4363 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:19:34.641458 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_concurrency.lockutils [None req-0df1998f-488c-4120-87fb-c671fd4e4363 admin admin] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:19:34.641896 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: DEBUG oslo_concurrency.lockutils [None req-0df1998f-488c-4120-87fb-c671fd4e4363 admin admin] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:19:34.663624 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: INFO nova.api.openstack.requestlog [None req-0df1998f-488c-4120-87fb-c671fd4e4363 admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077405 Dec 27 14:19:34.664135 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: [pid: 101657|app: 0|req: 38/77] 10.222.0.37 () {60 vars in 1193 bytes} [Mon Dec 27 14:19:34 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:20:32.347888 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: Mon Dec 27 14:20:32 2021 - graceful shutdown triggered... Dec 27 14:20:32.348391 dv-cinder-823015-1-iscsi devstack@n-api.service[101658]: Gracefully killing worker 2 (pid: 101658)... Dec 27 14:20:32.348024 dv-cinder-823015-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Dec 27 14:20:32.349160 dv-cinder-823015-1-iscsi devstack@n-api.service[101657]: Gracefully killing worker 1 (pid: 101657)... Dec 27 14:20:33.349049 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: worker 1 buried after 1 seconds Dec 27 14:20:33.349620 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: worker 2 buried after 1 seconds Dec 27 14:20:33.349620 dv-cinder-823015-1-iscsi devstack@n-api.service[101656]: goodbye to uWSGI. Dec 27 14:20:33.350797 dv-cinder-823015-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Dec 27 14:20:33.351342 dv-cinder-823015-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Dec 27 14:20:33.354144 dv-cinder-823015-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Dec 27 14:20:33.364185 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 27 14:20:33.366741 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Dec 27 14:20:33 2021] *** Dec 27 14:20:33.366899 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 27 14:20:33.367034 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 27 14:20:33.367153 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: nodename: dv-cinder-823015-1-iscsi Dec 27 14:20:33.367264 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: machine: x86_64 Dec 27 14:20:33.367387 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: clock source: unix Dec 27 14:20:33.367518 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: pcre jit disabled Dec 27 14:20:33.367518 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: detected number of CPU cores: 4 Dec 27 14:20:33.367518 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: current working directory: / Dec 27 14:20:33.367518 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: detected binary path: /usr/bin/uwsgi-core Dec 27 14:20:33.367518 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: your processes number limit is 47680 Dec 27 14:20:33.367518 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: your memory page size is 4096 bytes Dec 27 14:20:33.367518 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: detected max file descriptor number: 2048 Dec 27 14:20:33.367518 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: lock engine: pthread robust mutexes Dec 27 14:20:33.368340 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: thunder lock: enabled Dec 27 14:20:33.368340 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 27 14:20:33.368340 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 27 14:20:33.414215 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: Python main interpreter initialized at 0x55bc044329c0 Dec 27 14:20:33.414215 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: python threads support enabled Dec 27 14:20:33.414215 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: your server socket listen backlog is limited to 100 connections Dec 27 14:20:33.414215 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: your mercy for graceful operations on workers is 90 seconds Dec 27 14:20:33.414597 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: mapped 403077 bytes (393 KB) for 2 cores Dec 27 14:20:33.414597 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: *** Operational MODE: preforking *** Dec 27 14:20:33.414852 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: *** uWSGI is running in multiple interpreter mode *** Dec 27 14:20:33.414852 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: spawned uWSGI master process (pid: 116093) Dec 27 14:20:33.415056 dv-cinder-823015-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Dec 27 14:20:33.415623 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: spawned uWSGI worker 1 (pid: 116104, cores: 1) Dec 27 14:20:33.416202 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: spawned uWSGI worker 2 (pid: 116105, cores: 1) Dec 27 14:20:33.416496 dv-cinder-823015-1-iscsi devstack@n-api.service[116093]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 27 14:20:35.333712 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 27 14:20:35.333712 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: from cryptography.utils import int_from_bytes Dec 27 14:20:35.334392 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 27 14:20:35.334392 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: from cryptography.utils import int_from_bytes Dec 27 14:20:35.335431 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 27 14:20:35.335431 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: from cryptography.utils import int_from_bytes Dec 27 14:20:35.335986 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 27 14:20:35.335986 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: from cryptography.utils import int_from_bytes Dec 27 14:20:37.736064 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 27 14:20:37.736576 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 27 14:20:37.736851 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 27 14:20:37.737098 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 27 14:20:37.737355 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 27 14:20:37.737746 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.738073 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.738396 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.738717 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.739052 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.739365 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.739686 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.740054 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.740388 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.740652 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.740968 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.741300 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-823015-1-iscsi {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.741624 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.741932 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.742244 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.742562 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.742875 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.743200 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.743508 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.744036 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.745392 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.745392 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.745392 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.745392 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.745708 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.746031 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.746327 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.746662 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.747608 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.747956 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.748350 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-823015-1-iscsi {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.748649 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.748962 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.749280 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.749702 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.750033 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.750320 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.750648 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.750974 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.751280 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.751623 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.751972 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.752292 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.752618 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.752929 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.753242 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.753554 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.753875 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.754182 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.754489 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.754740 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.755047 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.755371 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.755694 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.756045 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.756300 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.756562 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.756869 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.757192 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.757501 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.757810 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.758115 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.758425 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.758733 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.759036 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.759414 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.759646 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.759992 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.760307 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.760631 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.760937 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.761257 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.761664 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.761924 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.762215 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.763073 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.763406 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.763714 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.764060 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.764386 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.764695 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.765002 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.767785 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.767785 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.767785 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.767785 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.767785 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.767785 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.767785 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.767785 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.769077 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.769077 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.769077 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.769077 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.769077 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.769848 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.769848 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.769848 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.771217 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.771217 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.771217 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.771217 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.771217 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.771999 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.771999 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.772317 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.772470 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.773208 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.773208 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.773514 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.773685 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.773900 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.774221 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.774528 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.774835 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.775154 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.775462 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.775770 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.776115 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.776414 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.776719 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.777036 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.777344 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.777650 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.777956 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.778883 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.779184 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.779490 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.779793 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.780121 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.780641 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.780813 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.781043 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.781354 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.781913 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.782226 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.782546 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.783111 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.783291 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.783554 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.783901 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.784213 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.784547 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.784868 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.785182 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.785497 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.785824 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.786137 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.786448 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.786759 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.787078 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.787397 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.787730 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.788072 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.788392 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.788713 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.789027 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.789347 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.789678 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.790005 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.790319 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.790793 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.791004 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.791732 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.791732 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.792081 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.792234 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 27 14:20:37.792892 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.793393 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 27 14:20:37.793574 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.793860 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 27 14:20:37.794023 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.794176 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 27 14:20:37.794334 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.794478 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 27 14:20:37.794632 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.794775 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.794931 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.795074 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.795224 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.795376 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.795519 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.795675 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.795827 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.795994 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.796161 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.796313 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.796463 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.796463 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.796759 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.796910 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.797069 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.797213 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.797354 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.797508 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.797667 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.797864 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.798019 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.798185 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.798342 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-823015-1-iscsi {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.798486 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.798643 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.798794 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.798944 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.799098 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.799251 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.799402 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.799544 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.799737 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.799924 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.800074 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.800239 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.800383 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.800523 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.800681 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.801112 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.801291 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.801437 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.801578 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.801746 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.801996 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.801996 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.802312 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.802467 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.802618 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.802768 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.802920 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.803069 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.803537 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.803689 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.803871 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.804119 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.804268 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.804419 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.804562 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.804723 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.804867 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.805015 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.805159 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-823015-1-iscsi {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.805315 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.805466 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.805615 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.805765 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.805916 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.806073 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.806223 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.806377 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.806537 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.806680 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.806827 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.807057 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.807213 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.807397 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.807544 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.807544 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.807821 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.808023 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.808168 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.808309 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.808486 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.809178 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.809299 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.809503 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.809591 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.809706 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.809794 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.809867 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.809951 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.810025 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.810094 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.810094 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.810228 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.810305 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.810389 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.810469 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.810547 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.810626 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.810697 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.810774 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.810846 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.810923 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.810993 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.811062 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.811130 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.811130 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.811269 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.811338 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.811406 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.811406 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.811540 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.811618 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.811691 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.811867 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.812023 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.812345 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.812445 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.812671 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.812761 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.812988 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.813076 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.813501 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.813608 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.813608 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.813886 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.813985 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.814064 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.814249 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.814356 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.814515 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.814597 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.814834 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.814928 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.815143 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.815229 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.815462 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.815587 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.815772 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.816461 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.816615 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.816771 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.816928 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.817072 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.817214 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.817376 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.817529 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.817673 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.817823 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.817967 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.818107 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.818248 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.818390 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.818547 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.818691 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.818832 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.818973 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.819131 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.819275 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.819425 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.819587 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.819736 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.819954 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.820113 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.820263 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.820421 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.820572 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.820572 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.820860 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.821010 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.821438 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.821607 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.821754 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.821754 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.822712 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.822866 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.823020 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.823164 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.823338 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.823338 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.823970 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.824543 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.824803 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.824979 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.825692 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.826153 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.826315 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.826315 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.826613 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.826759 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.826910 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.827053 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.827204 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.827361 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.827518 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.827677 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.827893 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.828046 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.828205 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.828363 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.828507 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.828657 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.828657 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.828937 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.829080 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.829232 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.829381 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.829532 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.829692 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.829835 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.829986 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.830143 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.830290 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.830439 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.830582 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.830730 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.830942 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.831096 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.831517 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.831694 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.831858 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.832030 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.832175 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.832326 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.832469 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.832625 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.832776 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.832929 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.833083 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.833227 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.833368 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.833519 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.833681 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.833993 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.834155 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.834308 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.834460 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.834715 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.834963 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.835112 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.835268 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.835420 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.835572 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.835725 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.835725 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.836020 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.836020 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.836020 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.836533 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.836677 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.836826 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.837042 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.837209 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.837362 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.837362 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.837655 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.837797 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.837947 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.838089 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.838245 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.838406 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.838552 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.838552 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.838820 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.838820 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.839096 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.839239 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.839382 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.839523 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.839672 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.839672 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.839985 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 27 14:20:37.840156 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.840308 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.840460 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.840604 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.841354 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.841802 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.841956 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.842106 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.842249 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.842391 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.842544 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.842698 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.842841 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.842994 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.843136 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.843278 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.843433 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.843577 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.843719 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.843918 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.844212 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.844355 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.844510 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.844654 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.844909 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.845166 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.845336 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.845482 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.845635 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.845794 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.845938 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.846091 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.846254 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.846480 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.846637 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.846790 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.846941 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.847085 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.847251 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.847404 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.847555 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.847699 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.847932 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.848083 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.848226 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.848380 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.848525 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.848667 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.848817 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.848962 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.849104 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.849277 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.849438 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.849656 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.849804 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.849946 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.850109 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.850264 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.850409 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.850551 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.850702 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.850702 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.850994 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.851139 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.851291 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.851291 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.851576 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.851576 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.852207 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.852363 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.852506 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.852661 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.852812 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.852955 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.853098 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.853240 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.853400 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.853553 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.853696 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.853838 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.853987 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.854270 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.854427 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.854585 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.854730 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.854896 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.855153 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.855387 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.855535 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.855703 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.855878 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.856029 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.856172 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.856387 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.856657 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.856817 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.857028 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.857179 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.857332 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.857485 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.857641 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.857794 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.857948 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.858091 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.858232 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.858383 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.858537 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.858680 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.858829 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.858972 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.859121 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.859263 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.859418 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.859569 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.859720 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.859931 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.860098 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.860322 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.860468 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.860620 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.860620 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.860905 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.861048 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.861199 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.861546 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.862171 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.862329 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.862492 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.862638 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.862790 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.862942 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.863094 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.863245 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.863396 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.863548 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.863701 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.863870 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.864020 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.864174 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.864479 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.864645 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.864645 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.865692 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.865859 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.866005 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.866147 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.866296 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.866749 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.866921 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.867084 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.867285 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.867452 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.867596 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.867739 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.867924 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.868084 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.868229 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.868450 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.868597 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.868748 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.868901 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.869045 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.869186 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.869336 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.869489 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.869641 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.869798 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.869951 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.870096 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.870246 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.870401 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.870554 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.870711 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.870855 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.870998 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.871139 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.871289 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.871451 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.871602 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.871753 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.871995 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.872474 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.872626 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.872778 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.872923 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.873076 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.873227 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.873379 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.873523 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.873678 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.873678 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.874045 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.874198 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.874525 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.874687 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.874847 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.874998 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.875142 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.875292 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.875435 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.875815 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.876020 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.876188 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.876333 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.876475 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.876624 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.876793 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.877017 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.877173 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.877324 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.877467 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.877611 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.877990 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.878144 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.878312 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.878501 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.878654 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.878805 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.878963 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.879385 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.879552 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.879706 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.879874 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.880131 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.880131 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.880559 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.880704 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.880847 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.880999 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.881157 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.881309 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.881460 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.881612 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.881763 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.881913 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.882070 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.882213 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.882708 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.882866 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.883011 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.883153 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.883316 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.883460 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.883604 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.883754 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.883973 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.884132 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.884286 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.884438 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.884756 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.884915 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.885061 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.885212 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.885357 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.885357 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.885639 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.886066 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.886066 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.886376 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.886521 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.886521 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.886803 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.886946 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.887194 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.887354 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.887354 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.888205 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.888364 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.888509 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.888652 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.888810 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.888955 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.889097 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.889238 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.889388 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.889546 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.889689 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.889838 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.889986 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.890147 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.890291 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.890442 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.890594 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.890738 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.890880 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.891022 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.891163 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.891318 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.891462 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.891680 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.891825 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.891991 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.892144 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.892298 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.892441 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.892883 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.893119 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.893276 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.893492 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.893639 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.893782 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.893924 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.894067 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.894210 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.894367 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.894533 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.894703 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.895008 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.895170 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.895321 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.895485 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.895637 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.895786 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.896028 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.896364 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.896524 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.896689 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.896860 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.897011 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.897011 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.897392 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.897556 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.897784 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.897965 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.898117 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.898267 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.898416 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.898579 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.898730 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.898879 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.899047 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.899206 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.899358 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.899516 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.899667 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.899829 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.900009 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.900162 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.900313 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.900471 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.900621 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.900771 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.900921 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.901079 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.901239 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.901391 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.901391 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.901673 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.901982 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.902137 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.902297 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.902494 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.902645 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.903078 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.903797 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.904009 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.904192 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.904345 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.904505 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.904663 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.904960 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.905137 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.905304 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.905463 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.905614 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.905776 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.905934 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.906094 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.906282 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.906621 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.907031 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.907182 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.907332 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.907611 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.907611 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.907931 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.908084 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.908231 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.908381 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.908577 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.908740 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.908910 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.909068 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.909219 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.909370 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.909528 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.909679 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.909839 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.909989 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.910153 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.910317 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.910477 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.910664 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.910864 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.911027 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.911177 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.911335 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.911486 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.911635 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.911790 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.912009 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.912172 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.912337 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.912490 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.912638 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.912787 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.913232 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.913388 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.913553 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.913711 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.913884 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.914041 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.914197 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.914366 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.914526 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.914526 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.914811 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.914978 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.915273 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.915446 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.915607 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.915766 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.915950 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.916113 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.916272 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.916429 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.916765 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.916924 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.917085 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.917237 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.917386 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.917551 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.917726 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.917877 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.918035 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.918187 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.918335 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.918483 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.918641 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.918827 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.918994 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.919152 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.919312 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.919464 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.919621 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.919798 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.920012 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.920166 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.920325 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.920484 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.920634 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.920799 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.920958 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.921109 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.921266 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.921416 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.921564 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.921739 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.921897 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.922047 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.922195 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.922345 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.922493 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.922651 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.922902 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.923321 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.923499 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.923712 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.923894 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.924067 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.924303 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.924471 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.924621 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.924778 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.925009 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.925306 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.925464 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.925622 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.925780 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.925931 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.926094 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.926245 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.926394 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.926563 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.926713 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.927057 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.927230 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.927383 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.927541 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.927703 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.927703 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.928015 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.928177 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.928327 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.928477 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.928635 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.928797 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.928956 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.929107 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.929256 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.929412 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.929569 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.929733 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.929901 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.930060 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.930209 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.930367 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.930517 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.930738 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.930912 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.931063 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.931220 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.931379 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.931379 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.931663 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.931823 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.932030 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.932190 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.932340 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.932497 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.932661 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.932833 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.932991 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.933169 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.933587 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.933746 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.933912 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.934071 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.934221 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.934408 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.934574 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.934574 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.934881 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.935033 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.935201 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.935509 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.935667 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.935817 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.936010 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.936163 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.936320 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.936482 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.936634 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.936792 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.936950 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.937301 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.937475 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.937654 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.937806 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.937969 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.938121 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.938270 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.938427 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.938586 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.938737 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.938904 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.939056 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.939214 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.939365 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.939533 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.939705 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.939919 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.940099 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.940266 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.940417 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.940580 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.941318 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.941481 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.941632 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.941790 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.941952 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.942127 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.942280 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.942429 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.942585 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.942585 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.942889 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.943039 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.943189 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.943338 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.943758 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.943948 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.944112 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.944263 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.944424 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.944573 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.944721 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.944870 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.945029 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.945180 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.945337 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.945638 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.945796 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.945955 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.946115 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.946267 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.946428 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.946578 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.946727 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.946886 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.947036 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.947184 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.947534 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.947699 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.947941 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.948112 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.948271 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.948423 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.948573 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.948742 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.948977 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.949139 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.949297 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.949449 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.949605 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.949766 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.949930 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.950604 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.950756 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.950905 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.951056 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.951205 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.951448 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.951623 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.951775 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.951992 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.952098 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.952191 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.952304 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.952395 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.952480 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.952574 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.952659 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.952762 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.952849 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.952935 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.953029 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.953124 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.953124 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.953291 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.953385 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.953478 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.953564 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.953654 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.953654 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.953804 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.953887 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.953960 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.954029 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.954099 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.954168 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.954247 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.954328 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.954412 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.954484 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.954555 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.954632 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.954713 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.954793 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.954871 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.954949 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.955029 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.955115 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.955188 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.955257 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.955334 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.955405 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.955483 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.955562 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.955647 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.955647 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.955782 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.955874 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.955961 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.956052 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.956146 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.956221 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.956298 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.956371 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.956449 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.956529 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.956601 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.956671 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.956749 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.956821 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.956905 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.956977 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.957046 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.957129 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.957209 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.957282 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.957365 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.957438 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.957515 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.957587 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.957656 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.957726 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.957805 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.957878 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.957878 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.958028 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.958102 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.958191 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.958264 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.958333 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.958402 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.958471 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.958568 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.958655 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.958728 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.958728 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.958852 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.958922 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.958990 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.959072 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.959144 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.959222 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.959293 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.959371 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.959442 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.959521 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.959601 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.959680 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.959759 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.959863 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.959953 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.960036 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.960109 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.960184 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.960255 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.960325 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.960406 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.960479 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.960549 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.960618 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.960696 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.960696 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.960837 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.960916 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.960998 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.961076 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.961148 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.961148 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.961292 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.961366 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.961444 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.961522 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.961601 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.961686 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.961758 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.961827 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.961905 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.961984 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.962057 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.962136 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.962208 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.962278 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.962348 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.962416 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.962485 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.962580 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.962665 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.962756 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.962829 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.962900 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.963013 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.963089 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.963165 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.963245 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.963332 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.963405 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.963502 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.963576 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.963645 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.963726 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.963807 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.963911 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.963995 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.964068 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.964137 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.964206 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.964275 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.964362 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.964434 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.964511 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.964589 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.964669 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.964669 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.964809 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.964882 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.964951 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.965020 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.965089 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.965170 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.965250 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.965330 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.965413 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.965413 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.965550 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.965621 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.965738 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.966346 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.966468 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.966559 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.966639 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.966724 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.967159 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.967258 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.967340 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.967427 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.967667 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.967828 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.967931 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.968002 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.968252 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.968361 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.968562 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.968666 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.968923 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.969016 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.969215 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.969307 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.969571 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.969666 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.969825 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.969933 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.970132 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.970227 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.970440 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.970542 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.970749 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.970851 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.971060 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.971155 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.971379 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.971481 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.971699 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.971792 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.972040 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.972141 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.972349 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.972450 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.972665 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.972758 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.972971 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.973071 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.973292 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.973395 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.973615 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.973717 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.973930 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.974034 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.974241 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.974332 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.974554 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.974646 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.974863 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.975035 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.975174 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.975267 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.975484 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.975576 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.975794 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.975924 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.976132 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.976233 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.976443 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.976535 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.976771 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.976873 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.977110 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.977365 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.977467 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.977554 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.977709 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.977811 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.978025 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.978174 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.978343 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.978480 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.978655 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.978762 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.978961 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.979067 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.979289 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.979427 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.979599 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.979726 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.979935 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.980047 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.980246 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.980349 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.980555 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.980656 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.980869 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.980961 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.981183 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.981939 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.982130 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.982280 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.982462 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.982612 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.982794 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.982938 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.983125 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.983262 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.983470 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.983586 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.983784 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.983953 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.984160 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.984279 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.984489 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.984583 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.984805 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.984908 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.985117 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.985218 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.985423 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.985524 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.985664 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 27 14:20:37.985846 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.986233 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.986533 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.986857 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.987204 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.987511 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.987852 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.988233 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.988549 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.988865 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.989186 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.989510 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.989833 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.990151 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.990467 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.990789 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.991108 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.991425 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.991742 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.992097 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.992427 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.992762 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.993106 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.993432 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.993753 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.994076 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.994398 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.994926 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.995253 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.995596 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.995957 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.996293 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.996616 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.997589 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.997876 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.998194 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.998524 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.998835 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.999154 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.999467 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:37.999796 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.000143 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.000457 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.000782 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.001100 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.001642 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.001999 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.002324 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.002665 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.003004 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.003334 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.003654 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.004275 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.004464 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.004624 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.004929 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.005250 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.005566 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.005881 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.006202 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.006521 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.006836 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.007155 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.007485 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.007976 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.008142 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.008457 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.008773 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.009016 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_db.sqlalchemy.engines [None req-1737a3fc-6bff-4811-a740-7ee630323cc9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 27 14:20:38.009172 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.009393 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.009685 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.009998 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.010311 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.010630 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.010942 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.011258 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.011570 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.011911 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.012228 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.012686 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.013086 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.013597 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.013913 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.014229 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.014559 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.014879 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.015213 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.015533 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.015867 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.016234 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.016559 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.017133 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.017651 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.017992 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.018353 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.018707 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.019029 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.019351 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.019671 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.020042 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.020368 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.020690 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.021011 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.021331 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.021649 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.021968 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.022289 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.022613 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.022934 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.023259 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.023614 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.023982 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.024313 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.024639 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.024964 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.025287 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.025608 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.025932 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.026255 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.026580 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.026923 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.027248 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.027564 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.028056 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.028439 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.028928 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.029261 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.029657 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.029916 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.030253 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.030575 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.030905 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.031227 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.031569 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.032211 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.032555 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.032898 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.033215 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.033531 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.033846 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.034167 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.034509 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.034853 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.035181 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.035513 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.035866 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.036189 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.036509 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.036843 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.037176 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.037501 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.037821 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.038224 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.038484 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.038805 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.039126 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.039443 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.039763 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.040108 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.040446 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.040783 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.041098 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.041435 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.041765 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.042092 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.042416 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.042740 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.043078 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.043398 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.043720 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.044582 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.044951 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.045230 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.045550 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.045884 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.046219 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.046556 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.046892 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.047248 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.047570 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.047947 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.048291 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.048614 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.048935 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.049250 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 27 14:20:38.049500 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 27 14:20:38.072219 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_db.sqlalchemy.engines [None req-d1bab98c-8e42-425d-a542-d43968293406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 27 14:20:38.074928 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.context [None req-1737a3fc-6bff-4811-a740-7ee630323cc9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5(cell1) {{(pid=116105) load_cells /opt/stack/nova/nova/context.py:464}} Dec 27 14:20:38.079238 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1737a3fc-6bff-4811-a740-7ee630323cc9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:20:38.080871 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1737a3fc-6bff-4811-a740-7ee630323cc9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:20:38.081680 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1737a3fc-6bff-4811-a740-7ee630323cc9 None None] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:20:38.083622 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1737a3fc-6bff-4811-a740-7ee630323cc9 None None] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:20:38.096478 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_db.sqlalchemy.engines [None req-1737a3fc-6bff-4811-a740-7ee630323cc9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 27 14:20:38.100405 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_db.sqlalchemy.engines [None req-1737a3fc-6bff-4811-a740-7ee630323cc9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 27 14:20:38.140402 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.context [None req-d1bab98c-8e42-425d-a542-d43968293406 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5(cell1) {{(pid=116104) load_cells /opt/stack/nova/nova/context.py:464}} Dec 27 14:20:38.144720 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1bab98c-8e42-425d-a542-d43968293406 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:20:38.146332 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1bab98c-8e42-425d-a542-d43968293406 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:20:38.147168 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1bab98c-8e42-425d-a542-d43968293406 None None] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:20:38.149169 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1bab98c-8e42-425d-a542-d43968293406 None None] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:20:38.162329 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_db.sqlalchemy.engines [None req-d1bab98c-8e42-425d-a542-d43968293406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 27 14:20:38.163690 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_db.sqlalchemy.engines [None req-d1bab98c-8e42-425d-a542-d43968293406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 27 14:20:38.259052 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_db.sqlalchemy.engines [None req-1737a3fc-6bff-4811-a740-7ee630323cc9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 27 14:20:38.329692 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_db.sqlalchemy.engines [None req-d1bab98c-8e42-425d-a542-d43968293406 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 27 14:20:38.578700 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: WARNING keystonemiddleware.auth_token [None req-1737a3fc-6bff-4811-a740-7ee630323cc9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 27 14:20:38.586031 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: WARNING keystonemiddleware.auth_token [None req-1737a3fc-6bff-4811-a740-7ee630323cc9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 27 14:20:38.664181 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: WARNING keystonemiddleware.auth_token [None req-d1bab98c-8e42-425d-a542-d43968293406 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 27 14:20:38.672407 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: WARNING keystonemiddleware.auth_token [None req-d1bab98c-8e42-425d-a542-d43968293406 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 27 14:20:38.925754 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: WARNING keystonemiddleware.auth_token [None req-1737a3fc-6bff-4811-a740-7ee630323cc9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 27 14:20:38.930950 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: WARNING keystonemiddleware.auth_token [None req-1737a3fc-6bff-4811-a740-7ee630323cc9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 27 14:20:38.936829 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55bc044329c0 pid: 116105 (default app) Dec 27 14:20:39.029405 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: WARNING keystonemiddleware.auth_token [None req-d1bab98c-8e42-425d-a542-d43968293406 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 27 14:20:39.034987 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: WARNING keystonemiddleware.auth_token [None req-d1bab98c-8e42-425d-a542-d43968293406 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 27 14:20:39.040373 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bc044329c0 pid: 116104 (default app) Dec 27 14:21:12.122568 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f0563778-fff6-47bb-a2fd-9b0e70ddbead tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] Action: 'create', calling method: .version_select at 0x7f802a2f1e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-989014987"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:21:13.034144 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c8459f22-9be8-479f-a184-8408237ae640 tempest-VolumesGetTestJSON-728629370 tempest-VolumesGetTestJSON-728629370-project] Action: 'create', calling method: .version_select at 0x7f802a2f1e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1802958167", "metadata": {"Type": "work"}}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:21:13.402201 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f0563778-fff6-47bb-a2fd-9b0e70ddbead tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.525672 Dec 27 14:21:13.403788 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 1/1] 10.222.0.37 () {60 vars in 1154 bytes} [Mon Dec 27 14:21:10 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 2529 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 27 14:21:13.591569 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8be58acb-abd7-4bd3-81be-83973b7dd44c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1751721372", "imageRef": "c8bd383f-96c5-4e2b-aaa5-fabd68b307f6", "flavorRef": "452", "networks": [{"uuid": "f572a130-3f83-4c3c-b51f-af2b9bc79a2e"}]}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:21:13.757305 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.network.neutron [None req-8be58acb-abd7-4bd3-81be-83973b7dd44c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] validate_networks() for [('f572a130-3f83-4c3c-b51f-af2b9bc79a2e', None, None, None, None, None)] {{(pid=116105) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 27 14:21:14.056976 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c8459f22-9be8-479f-a184-8408237ae640 tempest-VolumesGetTestJSON-728629370 tempest-VolumesGetTestJSON-728629370-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.316585 Dec 27 14:21:14.058431 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 1/2] 10.222.0.37 () {60 vars in 1155 bytes} [Mon Dec 27 14:21:11 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 2320 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 27 14:21:14.064938 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a66b1892-937e-4f87-a863-5e1a720c2200 tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] Calling method '.version_select at 0x7f802a1c89d0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:14.154871 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a66b1892-937e-4f87-a863-5e1a720c2200 tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/8e955262-edc2-442e-8ed6-bf71ba455c5e" status: 200 len: 345 microversion: 2.1 time: 0.094801 Dec 27 14:21:14.162783 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 2/3] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Dec 27 14:21:14 2021] GET /compute/v2.1/os-volumes/8e955262-edc2-442e-8ed6-bf71ba455c5e => generated 345 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:14.167904 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b9a8762a-9a0c-430c-b562-9e1c8049d042 tempest-VolumesGetTestJSON-728629370 tempest-VolumesGetTestJSON-728629370-project] Calling method '.version_select at 0x7f802a1c8d30>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:14.315011 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b9a8762a-9a0c-430c-b562-9e1c8049d042 tempest-VolumesGetTestJSON-728629370 tempest-VolumesGetTestJSON-728629370-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/1952836e-7e2a-4ee8-9732-5f8c3078f1df" status: 200 len: 353 microversion: 2.1 time: 0.150978 Dec 27 14:21:14.316509 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 3/4] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Dec 27 14:21:14 2021] GET /compute/v2.1/os-volumes/1952836e-7e2a-4ee8-9732-5f8c3078f1df => generated 353 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:14.324789 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-639f2285-72a8-4a4e-993e-89df96bdd0d1 tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] Action: 'create', calling method: .version_select at 0x7f802a1dc430>, body: {"snapshot": {"volume_id": "8e955262-edc2-442e-8ed6-bf71ba455c5e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-428244053"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:21:14.617620 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-639f2285-72a8-4a4e-993e-89df96bdd0d1 tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] 10.222.0.37 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.298356 Dec 27 14:21:14.618475 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 4/5] 10.222.0.37 () {60 vars in 1161 bytes} [Mon Dec 27 14:21:14 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:14.623203 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f0bc75cf-ac1c-4709-9d99-b0f6d034ce2b tempest-VolumesTestJSON-1834280203 tempest-VolumesTestJSON-1834280203-project] Calling method '.version_select at 0x7f802a164040>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:14.724366 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f0bc75cf-ac1c-4709-9d99-b0f6d034ce2b tempest-VolumesTestJSON-1834280203 tempest-VolumesTestJSON-1834280203-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/88bc3794-41de-4965-ad12-b8e0498c2e67" status: 200 len: 351 microversion: 2.1 time: 0.104694 Dec 27 14:21:14.737855 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 5/6] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Dec 27 14:21:14 2021] GET /compute/v2.1/os-volumes/88bc3794-41de-4965-ad12-b8e0498c2e67 => generated 351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:14.749941 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2a4c895a-36d7-4448-b277-fba426225a12 tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] Calling method '.version_select at 0x7f802a1c8a60>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:14.843152 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2a4c895a-36d7-4448-b277-fba426225a12 tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/722beb8c-3036-4a6d-a36d-9b0dde656b19" status: 200 len: 286 microversion: 2.1 time: 0.103837 Dec 27 14:21:14.843715 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 6/7] 10.222.0.37 () {58 vars in 1250 bytes} [Mon Dec 27 14:21:14 2021] GET /compute/v2.1/os-snapshots/722beb8c-3036-4a6d-a36d-9b0dde656b19 => generated 286 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:14.853852 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-df04abe2-d5b6-451a-a3b7-06cb2ceb4247 tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] Calling method '.version_select at 0x7f802a164310>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:14.898124 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-df04abe2-d5b6-451a-a3b7-06cb2ceb4247 tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.047817 Dec 27 14:21:14.905207 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 7/8] 10.222.0.37 () {58 vars in 1139 bytes} [Mon Dec 27 14:21:14 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:21:14.911377 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-905a9ab6-9cfd-4056-8055-9c4ecafa6061 tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] Calling method '.version_select at 0x7f802a2939d0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:14.975884 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-905a9ab6-9cfd-4056-8055-9c4ecafa6061 tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/722beb8c-3036-4a6d-a36d-9b0dde656b19" status: 200 len: 286 microversion: 2.1 time: 0.069287 Dec 27 14:21:14.976642 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 8/9] 10.222.0.37 () {58 vars in 1250 bytes} [Mon Dec 27 14:21:14 2021] GET /compute/v2.1/os-snapshots/722beb8c-3036-4a6d-a36d-9b0dde656b19 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:15.329727 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-8be58acb-abd7-4bd3-81be-83973b7dd44c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Flavor limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 27 14:21:15.330689 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-8be58acb-abd7-4bd3-81be-83973b7dd44c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Image limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 27 14:21:15.333136 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-eb5a42e0-a7c8-4535-92d1-b1f4b8c57781 tempest-VolumesGetTestJSON-728629370 tempest-VolumesGetTestJSON-728629370-project] Calling method '.version_select at 0x7f802a164f70>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:15.334107 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-8be58acb-abd7-4bd3-81be-83973b7dd44c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Flavor pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 27 14:21:15.334747 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-8be58acb-abd7-4bd3-81be-83973b7dd44c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Image pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 27 14:21:15.335336 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-8be58acb-abd7-4bd3-81be-83973b7dd44c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 27 14:21:15.375591 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8be58acb-abd7-4bd3-81be-83973b7dd44c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:15.376299 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8be58acb-abd7-4bd3-81be-83973b7dd44c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:15.377344 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8be58acb-abd7-4bd3-81be-83973b7dd44c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:15.377997 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8be58acb-abd7-4bd3-81be-83973b7dd44c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:15.460504 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-eb5a42e0-a7c8-4535-92d1-b1f4b8c57781 tempest-VolumesGetTestJSON-728629370 tempest-VolumesGetTestJSON-728629370-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/1952836e-7e2a-4ee8-9732-5f8c3078f1df" status: 200 len: 354 microversion: 2.1 time: 0.136402 Dec 27 14:21:15.467571 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 9/10] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Dec 27 14:21:15 2021] GET /compute/v2.1/os-volumes/1952836e-7e2a-4ee8-9732-5f8c3078f1df => generated 354 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:21:15.479600 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-55c2e648-34aa-4451-ab96-c86aaa298812 tempest-VolumesGetTestJSON-728629370 tempest-VolumesGetTestJSON-728629370-project] Calling method '.version_select at 0x7f802a1640d0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:15.528135 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-8be58acb-abd7-4bd3-81be-83973b7dd44c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Getting quotas for project 648321538a5a439baf7e39cee8742fc4. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:21:15.556199 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-8be58acb-abd7-4bd3-81be-83973b7dd44c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Getting quotas for user 2e4c89b986aa4f2690ee1587172c17cb and project 648321538a5a439baf7e39cee8742fc4. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:21:15.583350 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8be58acb-abd7-4bd3-81be-83973b7dd44c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Going to run 1 instances... {{(pid=116105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 27 14:21:15.586605 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8be58acb-abd7-4bd3-81be-83973b7dd44c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c8bd383f-96c5-4e2b-aaa5-fabd68b307f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 27 14:21:15.600667 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-55c2e648-34aa-4451-ab96-c86aaa298812 tempest-VolumesGetTestJSON-728629370 tempest-VolumesGetTestJSON-728629370-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/1952836e-7e2a-4ee8-9732-5f8c3078f1df" status: 200 len: 354 microversion: 2.1 time: 0.124728 Dec 27 14:21:15.612983 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 10/11] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Dec 27 14:21:15 2021] GET /compute/v2.1/os-volumes/1952836e-7e2a-4ee8-9732-5f8c3078f1df => generated 354 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:15.712908 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1ff77b0f-8c81-4597-a0dd-1b1aa3cd6fcc tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1426858902", "imageRef": "c8bd383f-96c5-4e2b-aaa5-fabd68b307f6", "flavorRef": "452", "networks": [{"uuid": "149dcfc0-946a-49fb-bf36-cbc1a9d4227e"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:21:15.754663 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8be58acb-abd7-4bd3-81be-83973b7dd44c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.349473 Dec 27 14:21:15.755630 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 2/12] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Dec 27 14:21:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 2351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 27 14:21:15.762303 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a2a9621c-f5d2-4eac-bc7f-c830a4235bd2 tempest-VolumesGetTestJSON-728629370 tempest-VolumesGetTestJSON-728629370-project] Calling method '.version_select at 0x7f802a0d8700>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:15.901272 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a2a9621c-f5d2-4eac-bc7f-c830a4235bd2 tempest-VolumesGetTestJSON-728629370 tempest-VolumesGetTestJSON-728629370-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/1952836e-7e2a-4ee8-9732-5f8c3078f1df" status: 202 len: 0 microversion: 2.1 time: 0.144402 Dec 27 14:21:15.905660 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 3/13] 10.222.0.37 () {58 vars in 1247 bytes} [Mon Dec 27 14:21:15 2021] DELETE /compute/v2.1/os-volumes/1952836e-7e2a-4ee8-9732-5f8c3078f1df => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:21:15.908115 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9fe251d1-901a-48b5-8d74-56c1e00fbc71 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:15.909097 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9fe251d1-901a-48b5-8d74-56c1e00fbc71 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:15.926707 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-1ff77b0f-8c81-4597-a0dd-1b1aa3cd6fcc tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] validate_networks() for [('149dcfc0-946a-49fb-bf36-cbc1a9d4227e', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 27 14:21:16.045751 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9fe251d1-901a-48b5-8d74-56c1e00fbc71 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:16.061996 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9fe251d1-901a-48b5-8d74-56c1e00fbc71 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1218 microversion: 2.1 time: 0.157941 Dec 27 14:21:16.062643 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 4/14] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:15 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1218 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:16.076908 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3a2cfbae-f4f8-455b-90f3-62bbd07d514b tempest-VolumesGetTestJSON-728629370 tempest-VolumesGetTestJSON-728629370-project] Calling method '.version_select at 0x7f802a1c6e50>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:16.178682 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3a2cfbae-f4f8-455b-90f3-62bbd07d514b tempest-VolumesGetTestJSON-728629370 tempest-VolumesGetTestJSON-728629370-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/1952836e-7e2a-4ee8-9732-5f8c3078f1df" status: 200 len: 353 microversion: 2.1 time: 0.113775 Dec 27 14:21:16.180026 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 5/15] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Dec 27 14:21:16 2021] GET /compute/v2.1/os-volumes/1952836e-7e2a-4ee8-9732-5f8c3078f1df => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:16.185915 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2dc49ee6-f0cc-47a1-b358-fcfe9067debe tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] Calling method '.version_select at 0x7f8029883d30>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:16.279298 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2dc49ee6-f0cc-47a1-b358-fcfe9067debe tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/722beb8c-3036-4a6d-a36d-9b0dde656b19" status: 200 len: 286 microversion: 2.1 time: 0.067760 Dec 27 14:21:16.279298 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 6/16] 10.222.0.37 () {58 vars in 1250 bytes} [Mon Dec 27 14:21:16 2021] GET /compute/v2.1/os-snapshots/722beb8c-3036-4a6d-a36d-9b0dde656b19 => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:17.080225 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-22c5fac6-9ea8-4df6-9525-ac2238c8eb91 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:17.080973 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-22c5fac6-9ea8-4df6-9525-ac2238c8eb91 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:17.091025 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-22c5fac6-9ea8-4df6-9525-ac2238c8eb91 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:17.091574 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-22c5fac6-9ea8-4df6-9525-ac2238c8eb91 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:17.093881 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-22c5fac6-9ea8-4df6-9525-ac2238c8eb91 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:17.094427 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-22c5fac6-9ea8-4df6-9525-ac2238c8eb91 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:17.152476 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-1ff77b0f-8c81-4597-a0dd-1b1aa3cd6fcc tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 27 14:21:17.153051 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-1ff77b0f-8c81-4597-a0dd-1b1aa3cd6fcc tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 27 14:21:17.153394 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-1ff77b0f-8c81-4597-a0dd-1b1aa3cd6fcc tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 27 14:21:17.153790 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-1ff77b0f-8c81-4597-a0dd-1b1aa3cd6fcc tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 27 14:21:17.154202 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-1ff77b0f-8c81-4597-a0dd-1b1aa3cd6fcc tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 27 14:21:17.179072 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ff77b0f-8c81-4597-a0dd-1b1aa3cd6fcc tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:17.179525 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ff77b0f-8c81-4597-a0dd-1b1aa3cd6fcc tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:17.180370 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ff77b0f-8c81-4597-a0dd-1b1aa3cd6fcc tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:17.190701 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1ff77b0f-8c81-4597-a0dd-1b1aa3cd6fcc tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:17.263732 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-1ff77b0f-8c81-4597-a0dd-1b1aa3cd6fcc tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Getting quotas for project e37ac1308b3b47e2a00660c375407525. Resources: {'cores', 'ram', 'instances'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:21:17.274013 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-1ff77b0f-8c81-4597-a0dd-1b1aa3cd6fcc tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Getting quotas for user 39da56a4e80e478eb32e7f096eb7396e and project e37ac1308b3b47e2a00660c375407525. Resources: {'cores', 'ram', 'instances'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:21:17.295666 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1ff77b0f-8c81-4597-a0dd-1b1aa3cd6fcc tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 27 14:21:17.298564 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1ff77b0f-8c81-4597-a0dd-1b1aa3cd6fcc tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c8bd383f-96c5-4e2b-aaa5-fabd68b307f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 27 14:21:17.412250 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-22c5fac6-9ea8-4df6-9525-ac2238c8eb91 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:17.434194 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-22c5fac6-9ea8-4df6-9525-ac2238c8eb91 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1222 microversion: 2.1 time: 0.354721 Dec 27 14:21:17.435283 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 7/17] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:17 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1222 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:17.449813 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-18d261e0-9883-4676-bbc5-74c129452512 tempest-VolumesGetTestJSON-728629370 tempest-VolumesGetTestJSON-728629370-project] Calling method '.version_select at 0x7f8029014550>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:17.462612 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1ff77b0f-8c81-4597-a0dd-1b1aa3cd6fcc tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.848075 Dec 27 14:21:17.463722 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 11/18] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Dec 27 14:21:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 1850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 27 14:21:17.469001 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-271d01a9-82f8-4828-99d0-5284568e7f80 tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] Calling method '.version_select at 0x7f802985e310>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:17.534678 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-271d01a9-82f8-4828-99d0-5284568e7f80 tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/722beb8c-3036-4a6d-a36d-9b0dde656b19" status: 200 len: 286 microversion: 2.1 time: 0.069431 Dec 27 14:21:17.538862 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 12/19] 10.222.0.37 () {58 vars in 1250 bytes} [Mon Dec 27 14:21:17 2021] GET /compute/v2.1/os-snapshots/722beb8c-3036-4a6d-a36d-9b0dde656b19 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:17.540475 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4030e1f4-7289-49c8-9df3-8218e1830d41 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:17.541312 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4030e1f4-7289-49c8-9df3-8218e1830d41 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:17.601840 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-18d261e0-9883-4676-bbc5-74c129452512 tempest-VolumesGetTestJSON-728629370 tempest-VolumesGetTestJSON-728629370-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/1952836e-7e2a-4ee8-9732-5f8c3078f1df" status: 200 len: 353 microversion: 2.1 time: 0.165190 Dec 27 14:21:17.607302 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 8/20] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Dec 27 14:21:17 2021] GET /compute/v2.1/os-volumes/1952836e-7e2a-4ee8-9732-5f8c3078f1df => generated 353 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:17.747421 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4030e1f4-7289-49c8-9df3-8218e1830d41 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:17.764845 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4030e1f4-7289-49c8-9df3-8218e1830d41 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1215 microversion: 2.1 time: 0.228022 Dec 27 14:21:17.770929 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 13/21] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:17 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1215 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:18.451325 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ea21403a-6d6e-4e6a-89e5-188f637cd30e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:18.452308 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ea21403a-6d6e-4e6a-89e5-188f637cd30e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:18.464789 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ea21403a-6d6e-4e6a-89e5-188f637cd30e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:18.466111 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ea21403a-6d6e-4e6a-89e5-188f637cd30e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:18.467132 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ea21403a-6d6e-4e6a-89e5-188f637cd30e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:18.468735 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ea21403a-6d6e-4e6a-89e5-188f637cd30e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:18.548774 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-096fdd4c-6c20-4174-8de7-258e86a0d679 tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] Calling method '.version_select at 0x7f8029878d30>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:18.613175 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-096fdd4c-6c20-4174-8de7-258e86a0d679 tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/722beb8c-3036-4a6d-a36d-9b0dde656b19" status: 200 len: 286 microversion: 2.1 time: 0.070379 Dec 27 14:21:18.613991 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 14/22] 10.222.0.37 () {58 vars in 1250 bytes} [Mon Dec 27 14:21:18 2021] GET /compute/v2.1/os-snapshots/722beb8c-3036-4a6d-a36d-9b0dde656b19 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:18.618290 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-93cdcacc-837f-4354-bebd-cf68ed0ee866 tempest-VolumesGetTestJSON-728629370 tempest-VolumesGetTestJSON-728629370-project] Calling method '.version_select at 0x7f8029895e50>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:18.643566 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ea21403a-6d6e-4e6a-89e5-188f637cd30e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:18.665221 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ea21403a-6d6e-4e6a-89e5-188f637cd30e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1222 microversion: 2.1 time: 0.215557 Dec 27 14:21:18.667259 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 9/23] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:18 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1222 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:18.737565 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-93cdcacc-837f-4354-bebd-cf68ed0ee866 tempest-VolumesGetTestJSON-728629370 tempest-VolumesGetTestJSON-728629370-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/1952836e-7e2a-4ee8-9732-5f8c3078f1df" status: 200 len: 353 microversion: 2.1 time: 0.122512 Dec 27 14:21:18.738928 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 15/24] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Dec 27 14:21:18 2021] GET /compute/v2.1/os-volumes/1952836e-7e2a-4ee8-9732-5f8c3078f1df => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:18.788895 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-eface8b2-6691-4da4-bddf-116c555f1195 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:18.789738 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-eface8b2-6691-4da4-bddf-116c555f1195 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:18.803587 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eface8b2-6691-4da4-bddf-116c555f1195 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:18.805119 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eface8b2-6691-4da4-bddf-116c555f1195 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:18.805986 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eface8b2-6691-4da4-bddf-116c555f1195 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:18.809759 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eface8b2-6691-4da4-bddf-116c555f1195 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:18.934271 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-eface8b2-6691-4da4-bddf-116c555f1195 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:18.946596 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-eface8b2-6691-4da4-bddf-116c555f1195 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1219 microversion: 2.1 time: 0.161764 Dec 27 14:21:18.947104 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 10/25] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:18 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1219 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:19.631044 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fbcad20f-531b-4ddd-b73e-4cdec8af03d6 tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] Calling method '.version_select at 0x7f8029021820>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:19.683401 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7bb41943-5b29-4472-9117-f69d80fada20 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:19.684903 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7bb41943-5b29-4472-9117-f69d80fada20 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:19.701097 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fbcad20f-531b-4ddd-b73e-4cdec8af03d6 tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/722beb8c-3036-4a6d-a36d-9b0dde656b19" status: 200 len: 286 microversion: 2.1 time: 0.076638 Dec 27 14:21:19.701665 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 16/26] 10.222.0.37 () {58 vars in 1250 bytes} [Mon Dec 27 14:21:19 2021] GET /compute/v2.1/os-snapshots/722beb8c-3036-4a6d-a36d-9b0dde656b19 => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:19.704697 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7bb41943-5b29-4472-9117-f69d80fada20 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:19.705371 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7bb41943-5b29-4472-9117-f69d80fada20 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:19.706467 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7bb41943-5b29-4472-9117-f69d80fada20 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:19.707092 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7bb41943-5b29-4472-9117-f69d80fada20 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:19.751784 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4ec0a890-8cca-400e-8e54-37a76caf3261 tempest-VolumesGetTestJSON-728629370 tempest-VolumesGetTestJSON-728629370-project] Calling method '.version_select at 0x7f8029021f70>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:19.922703 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4ec0a890-8cca-400e-8e54-37a76caf3261 tempest-VolumesGetTestJSON-728629370 tempest-VolumesGetTestJSON-728629370-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/1952836e-7e2a-4ee8-9732-5f8c3078f1df" status: 200 len: 353 microversion: 2.1 time: 0.174539 Dec 27 14:21:19.923576 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 17/27] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Dec 27 14:21:19 2021] GET /compute/v2.1/os-volumes/1952836e-7e2a-4ee8-9732-5f8c3078f1df => generated 353 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:19.944798 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-7bb41943-5b29-4472-9117-f69d80fada20 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:19.965936 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-977fe300-f1bc-4eaa-ad5c-d084937becc6 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:19.966864 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-977fe300-f1bc-4eaa-ad5c-d084937becc6 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:19.967754 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7bb41943-5b29-4472-9117-f69d80fada20 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1214 microversion: 2.1 time: 0.284900 Dec 27 14:21:19.975743 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 11/28] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:19 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1214 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:21:19.986281 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-977fe300-f1bc-4eaa-ad5c-d084937becc6 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:19.995709 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-977fe300-f1bc-4eaa-ad5c-d084937becc6 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:19.996621 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-977fe300-f1bc-4eaa-ad5c-d084937becc6 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:19.997085 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-977fe300-f1bc-4eaa-ad5c-d084937becc6 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:20.357400 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-977fe300-f1bc-4eaa-ad5c-d084937becc6 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:20.389391 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-977fe300-f1bc-4eaa-ad5c-d084937becc6 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1211 microversion: 2.1 time: 0.422665 Dec 27 14:21:20.391740 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 18/29] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:19 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1211 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:20.712642 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ae38fc9a-bff2-45e0-b756-5197f15c549c tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] Calling method '.version_select at 0x7f8028fbab80>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:20.765226 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d5e40124-f0dc-4e16-8e47-40f8cc6f5667 tempest-VolumesTestJSON-1834280203 tempest-VolumesTestJSON-1834280203-project] Calling method '.version_select at 0x7f8028fa3430>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:20.819703 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ae38fc9a-bff2-45e0-b756-5197f15c549c tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/722beb8c-3036-4a6d-a36d-9b0dde656b19" status: 200 len: 287 microversion: 2.1 time: 0.111269 Dec 27 14:21:20.820381 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 12/30] 10.222.0.37 () {58 vars in 1250 bytes} [Mon Dec 27 14:21:20 2021] GET /compute/v2.1/os-snapshots/722beb8c-3036-4a6d-a36d-9b0dde656b19 => generated 287 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:20.831542 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7688d1b4-b2a6-4df8-a259-efe6694bcc63 tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] Calling method '.version_select at 0x7f80290145e0>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:20.967873 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d5e40124-f0dc-4e16-8e47-40f8cc6f5667 tempest-VolumesTestJSON-1834280203 tempest-VolumesTestJSON-1834280203-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/60efcd31-06a6-4333-ac08-16df051b1de4" status: 200 len: 351 microversion: 2.1 time: 0.207011 Dec 27 14:21:20.969164 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 19/31] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Dec 27 14:21:20 2021] GET /compute/v2.1/os-volumes/60efcd31-06a6-4333-ac08-16df051b1de4 => generated 351 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:20.978734 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c2d6dbcc-8e62-4219-bab4-45d42c53ce20 tempest-VolumesGetTestJSON-728629370 tempest-VolumesGetTestJSON-728629370-project] Calling method '.version_select at 0x7f8028fc0310>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:21.037100 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7688d1b4-b2a6-4df8-a259-efe6694bcc63 tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] 10.222.0.37 "DELETE /compute/v2.1/os-snapshots/722beb8c-3036-4a6d-a36d-9b0dde656b19" status: 202 len: 0 microversion: 2.1 time: 0.209227 Dec 27 14:21:21.037674 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 13/32] 10.222.0.37 () {58 vars in 1253 bytes} [Mon Dec 27 14:21:20 2021] DELETE /compute/v2.1/os-snapshots/722beb8c-3036-4a6d-a36d-9b0dde656b19 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:21:21.175799 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-09dadc7b-4fc9-4e8a-9d3d-0d66964c0a76 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'create', calling method: .version_select at 0x7f80298720d0>, body: {"keypair": {"name": "tempest-keypair-1427882894"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:21:21.316127 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-09dadc7b-4fc9-4e8a-9d3d-0d66964c0a76 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Getting quotas for project 3987a0b7a4764509990d2849d59e6238. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:21:21.332996 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-09dadc7b-4fc9-4e8a-9d3d-0d66964c0a76 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Getting quotas for user 4c8987f7dafc41f999a222eb0145ae95 and project 3987a0b7a4764509990d2849d59e6238. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:21:21.467788 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-c2d6dbcc-8e62-4219-bab4-45d42c53ce20 tempest-VolumesGetTestJSON-728629370 tempest-VolumesGetTestJSON-728629370-project] HTTP exception thrown: Volume 1952836e-7e2a-4ee8-9732-5f8c3078f1df could not be found. Dec 27 14:21:21.468424 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c2d6dbcc-8e62-4219-bab4-45d42c53ce20 tempest-VolumesGetTestJSON-728629370 tempest-VolumesGetTestJSON-728629370-project] Returning 404 to user: Volume 1952836e-7e2a-4ee8-9732-5f8c3078f1df could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:21:21.469264 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c2d6dbcc-8e62-4219-bab4-45d42c53ce20 tempest-VolumesGetTestJSON-728629370 tempest-VolumesGetTestJSON-728629370-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/1952836e-7e2a-4ee8-9732-5f8c3078f1df" status: 404 len: 109 microversion: 2.1 time: 0.498955 Dec 27 14:21:21.469822 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 20/33] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Dec 27 14:21:20 2021] GET /compute/v2.1/os-volumes/1952836e-7e2a-4ee8-9732-5f8c3078f1df => generated 109 bytes in 500 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:21:21.485524 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b4f3c486-8019-4eca-90ac-a535a55bc3c8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:21.496725 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b4f3c486-8019-4eca-90ac-a535a55bc3c8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:21.528894 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4f3c486-8019-4eca-90ac-a535a55bc3c8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:21.530413 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4f3c486-8019-4eca-90ac-a535a55bc3c8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:21.545094 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4f3c486-8019-4eca-90ac-a535a55bc3c8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:21.547680 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4f3c486-8019-4eca-90ac-a535a55bc3c8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:21.878763 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b4f3c486-8019-4eca-90ac-a535a55bc3c8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:21.895625 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b4f3c486-8019-4eca-90ac-a535a55bc3c8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1276 microversion: 2.1 time: 0.417111 Dec 27 14:21:21.905598 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 21/34] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:21 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1276 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:21.921802 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-248e935c-ea44-4f15-8607-b7cd262d029d tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] Calling method '.version_select at 0x7f8028fced30>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:22.017207 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-248e935c-ea44-4f15-8607-b7cd262d029d tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] HTTP exception thrown: Snapshot 722beb8c-3036-4a6d-a36d-9b0dde656b19 could not be found. Dec 27 14:21:22.018752 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-248e935c-ea44-4f15-8607-b7cd262d029d tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] Returning 404 to user: Snapshot 722beb8c-3036-4a6d-a36d-9b0dde656b19 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:21:22.019677 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-248e935c-ea44-4f15-8607-b7cd262d029d tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/722beb8c-3036-4a6d-a36d-9b0dde656b19" status: 404 len: 111 microversion: 2.1 time: 0.112327 Dec 27 14:21:22.020364 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 22/35] 10.222.0.37 () {58 vars in 1250 bytes} [Mon Dec 27 14:21:21 2021] GET /compute/v2.1/os-snapshots/722beb8c-3036-4a6d-a36d-9b0dde656b19 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:21:22.095495 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-09dadc7b-4fc9-4e8a-9d3d-0d66964c0a76 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Getting quotas for project 3987a0b7a4764509990d2849d59e6238. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:21:22.110961 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-09dadc7b-4fc9-4e8a-9d3d-0d66964c0a76 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Getting quotas for user 4c8987f7dafc41f999a222eb0145ae95 and project 3987a0b7a4764509990d2849d59e6238. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:21:22.173977 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-09dadc7b-4fc9-4e8a-9d3d-0d66964c0a76 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.133639 Dec 27 14:21:22.181262 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 14/36] 10.222.0.37 () {60 vars in 1157 bytes} [Mon Dec 27 14:21:21 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:22.189458 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a48ec8e7-39cf-4383-b5a3-1771e9f76f2e tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:22.190491 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a48ec8e7-39cf-4383-b5a3-1771e9f76f2e tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:22.199614 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a48ec8e7-39cf-4383-b5a3-1771e9f76f2e tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:22.200524 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a48ec8e7-39cf-4383-b5a3-1771e9f76f2e tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:22.201502 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a48ec8e7-39cf-4383-b5a3-1771e9f76f2e tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:22.202393 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a48ec8e7-39cf-4383-b5a3-1771e9f76f2e tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:22.411107 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a48ec8e7-39cf-4383-b5a3-1771e9f76f2e tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:22.437259 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a48ec8e7-39cf-4383-b5a3-1771e9f76f2e tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1273 microversion: 2.1 time: 0.253924 Dec 27 14:21:22.440110 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 15/37] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:22 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1273 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:22.456354 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6a2ea481-1e2b-40da-9360-17283b4351ba tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] Calling method '.version_select at 0x7f8028f92160>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:22.563073 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7d72c31d-2e2a-4518-ab66-b66bd46e52ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-743170285", "imageRef": "c8bd383f-96c5-4e2b-aaa5-fabd68b307f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d69ed432-f936-4488-b3c6-1b0b85e4dc0f"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:21:22.645496 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6a2ea481-1e2b-40da-9360-17283b4351ba tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/8e955262-edc2-442e-8ed6-bf71ba455c5e" status: 202 len: 0 microversion: 2.1 time: 0.204296 Dec 27 14:21:22.646080 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 16/38] 10.222.0.37 () {58 vars in 1247 bytes} [Mon Dec 27 14:21:22 2021] DELETE /compute/v2.1/os-volumes/8e955262-edc2-442e-8ed6-bf71ba455c5e => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:21:22.654110 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c13573c9-326e-445b-8ea0-906ed8b6beab tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] Calling method '.version_select at 0x7f8028f92a60>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:22.709090 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-7d72c31d-2e2a-4518-ab66-b66bd46e52ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] validate_networks() for [('d69ed432-f936-4488-b3c6-1b0b85e4dc0f', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 27 14:21:22.800851 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c13573c9-326e-445b-8ea0-906ed8b6beab tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/8e955262-edc2-442e-8ed6-bf71ba455c5e" status: 200 len: 344 microversion: 2.1 time: 0.150310 Dec 27 14:21:22.806341 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 17/39] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Dec 27 14:21:22 2021] GET /compute/v2.1/os-volumes/8e955262-edc2-442e-8ed6-bf71ba455c5e => generated 344 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:21:22.923025 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ead9c513-3369-4109-b278-5333a5f9125d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:22.923747 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ead9c513-3369-4109-b278-5333a5f9125d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:22.947505 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ead9c513-3369-4109-b278-5333a5f9125d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:22.957162 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ead9c513-3369-4109-b278-5333a5f9125d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:22.959295 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ead9c513-3369-4109-b278-5333a5f9125d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:22.959753 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ead9c513-3369-4109-b278-5333a5f9125d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:23.549674 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ead9c513-3369-4109-b278-5333a5f9125d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:23.560844 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ead9c513-3369-4109-b278-5333a5f9125d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1276 microversion: 2.1 time: 0.641809 Dec 27 14:21:23.561443 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 18/40] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:22 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1276 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:23.581120 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-74ad6594-4582-4fc7-9a6e-0d547ed6dd95 tempest-VolumesTestJSON-1834280203 tempest-VolumesTestJSON-1834280203-project] Calling method '.version_select at 0x7f8028f92af0>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:23.699477 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-74ad6594-4582-4fc7-9a6e-0d547ed6dd95 tempest-VolumesTestJSON-1834280203 tempest-VolumesTestJSON-1834280203-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/897009ae-a7b4-463e-a469-0c2cb3ef18e2" status: 200 len: 350 microversion: 2.1 time: 0.135575 Dec 27 14:21:23.700509 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 19/41] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Dec 27 14:21:23 2021] GET /compute/v2.1/os-volumes/897009ae-a7b4-463e-a469-0c2cb3ef18e2 => generated 350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:23.710956 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7769b847-4029-4077-92de-e4f771b6218f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:23.711981 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7769b847-4029-4077-92de-e4f771b6218f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:23.727993 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7769b847-4029-4077-92de-e4f771b6218f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:23.729189 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7769b847-4029-4077-92de-e4f771b6218f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:23.730977 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7769b847-4029-4077-92de-e4f771b6218f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:23.732249 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7769b847-4029-4077-92de-e4f771b6218f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:23.872983 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-7769b847-4029-4077-92de-e4f771b6218f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:23.888000 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7769b847-4029-4077-92de-e4f771b6218f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1273 microversion: 2.1 time: 0.184863 Dec 27 14:21:23.898623 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 20/42] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:23 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1273 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:23.916456 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-dce8d86e-e79c-41a8-9b87-1b1563305064 tempest-VolumesTestJSON-1834280203 tempest-VolumesTestJSON-1834280203-project] Calling method '.version_select at 0x7f8028f92040>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:24.114210 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-dce8d86e-e79c-41a8-9b87-1b1563305064 tempest-VolumesTestJSON-1834280203 tempest-VolumesTestJSON-1834280203-project] 10.222.0.37 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.213167 Dec 27 14:21:24.114996 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 21/43] 10.222.0.37 () {58 vars in 1133 bytes} [Mon Dec 27 14:21:23 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:24.119592 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9c344a36-8927-48ab-b452-99021a1e4584 tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] Calling method '.version_select at 0x7f8028f92280>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:24.169251 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-9c344a36-8927-48ab-b452-99021a1e4584 tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] HTTP exception thrown: Volume 8e955262-edc2-442e-8ed6-bf71ba455c5e could not be found. Dec 27 14:21:24.170745 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9c344a36-8927-48ab-b452-99021a1e4584 tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] Returning 404 to user: Volume 8e955262-edc2-442e-8ed6-bf71ba455c5e could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:21:24.171869 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9c344a36-8927-48ab-b452-99021a1e4584 tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/8e955262-edc2-442e-8ed6-bf71ba455c5e" status: 404 len: 109 microversion: 2.1 time: 0.055697 Dec 27 14:21:24.172653 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 22/44] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Dec 27 14:21:24 2021] GET /compute/v2.1/os-volumes/8e955262-edc2-442e-8ed6-bf71ba455c5e => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:21:24.177416 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5dc1134b-475a-4616-93d5-a97cc80848d5 tempest-VolumesTestJSON-1834280203 tempest-VolumesTestJSON-1834280203-project] Calling method '.version_select at 0x7f8028f92550>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:24.350515 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5dc1134b-475a-4616-93d5-a97cc80848d5 tempest-VolumesTestJSON-1834280203 tempest-VolumesTestJSON-1834280203-project] 10.222.0.37 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.176330 Dec 27 14:21:24.351128 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 23/45] 10.222.0.37 () {58 vars in 1148 bytes} [Mon Dec 27 14:21:24 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:24.370623 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d61ec2b2-b9fb-4329-8244-a36e9d0181ef tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] Calling method '.version_select at 0x7f802871be50>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:24.435422 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-d61ec2b2-b9fb-4329-8244-a36e9d0181ef tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] HTTP exception thrown: Volume 8e955262-edc2-442e-8ed6-bf71ba455c5e could not be found. Dec 27 14:21:24.436370 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d61ec2b2-b9fb-4329-8244-a36e9d0181ef tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] Returning 404 to user: Volume 8e955262-edc2-442e-8ed6-bf71ba455c5e could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:21:24.437383 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d61ec2b2-b9fb-4329-8244-a36e9d0181ef tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/8e955262-edc2-442e-8ed6-bf71ba455c5e" status: 404 len: 109 microversion: 2.1 time: 0.073301 Dec 27 14:21:24.438170 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 24/46] 10.222.0.37 () {58 vars in 1247 bytes} [Mon Dec 27 14:21:24 2021] DELETE /compute/v2.1/os-volumes/8e955262-edc2-442e-8ed6-bf71ba455c5e => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:21:24.447819 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0eabfa9f-2956-44eb-8d0c-b5aead6b1d82 tempest-VolumesTestJSON-1834280203 tempest-VolumesTestJSON-1834280203-project] Calling method '.version_select at 0x7f8029014040>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:24.734195 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0eabfa9f-2956-44eb-8d0c-b5aead6b1d82 tempest-VolumesTestJSON-1834280203 tempest-VolumesTestJSON-1834280203-project] 10.222.0.37 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.290614 Dec 27 14:21:24.735416 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 25/47] 10.222.0.37 () {58 vars in 1133 bytes} [Mon Dec 27 14:21:24 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:24.757716 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d5945a15-6e27-4779-9999-7be065108f1e tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] Calling method '.version_select at 0x7f802871b550>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:24.822101 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-d5945a15-6e27-4779-9999-7be065108f1e tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] HTTP exception thrown: Volume 8e955262-edc2-442e-8ed6-bf71ba455c5e could not be found. Dec 27 14:21:24.823020 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d5945a15-6e27-4779-9999-7be065108f1e tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] Returning 404 to user: Volume 8e955262-edc2-442e-8ed6-bf71ba455c5e could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:21:24.824489 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d5945a15-6e27-4779-9999-7be065108f1e tempest-VolumesSnapshotsTestJSON-660719535 tempest-VolumesSnapshotsTestJSON-660719535-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/8e955262-edc2-442e-8ed6-bf71ba455c5e" status: 404 len: 109 microversion: 2.1 time: 0.075889 Dec 27 14:21:24.831128 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 26/48] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Dec 27 14:21:24 2021] GET /compute/v2.1/os-volumes/8e955262-edc2-442e-8ed6-bf71ba455c5e => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:21:24.837003 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0a1ff5c9-f8be-4d86-bbb4-c94ab705704e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:24.843815 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0a1ff5c9-f8be-4d86-bbb4-c94ab705704e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:24.858470 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0a1ff5c9-f8be-4d86-bbb4-c94ab705704e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:24.860051 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0a1ff5c9-f8be-4d86-bbb4-c94ab705704e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:24.861183 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0a1ff5c9-f8be-4d86-bbb4-c94ab705704e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:24.862469 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0a1ff5c9-f8be-4d86-bbb4-c94ab705704e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:24.885077 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-7d72c31d-2e2a-4518-ab66-b66bd46e52ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 27 14:21:24.886464 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-7d72c31d-2e2a-4518-ab66-b66bd46e52ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 27 14:21:24.887251 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-7d72c31d-2e2a-4518-ab66-b66bd46e52ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 27 14:21:24.887815 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-7d72c31d-2e2a-4518-ab66-b66bd46e52ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 27 14:21:24.888416 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-7d72c31d-2e2a-4518-ab66-b66bd46e52ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 27 14:21:24.908388 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7d72c31d-2e2a-4518-ab66-b66bd46e52ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:24.910424 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7d72c31d-2e2a-4518-ab66-b66bd46e52ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:24.911442 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7d72c31d-2e2a-4518-ab66-b66bd46e52ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:24.912936 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7d72c31d-2e2a-4518-ab66-b66bd46e52ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:24.976981 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-7d72c31d-2e2a-4518-ab66-b66bd46e52ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Getting quotas for project 5516ca8550bb4056a7966db3f506971b. Resources: {'cores', 'ram', 'instances'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:21:24.996840 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-7d72c31d-2e2a-4518-ab66-b66bd46e52ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Getting quotas for user 58ff109f2ce44078a5cd96cc901ffcdd and project 5516ca8550bb4056a7966db3f506971b. Resources: {'cores', 'ram', 'instances'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:21:25.060224 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7d72c31d-2e2a-4518-ab66-b66bd46e52ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 27 14:21:25.067198 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7d72c31d-2e2a-4518-ab66-b66bd46e52ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c8bd383f-96c5-4e2b-aaa5-fabd68b307f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 27 14:21:25.256668 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7d72c31d-2e2a-4518-ab66-b66bd46e52ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.227851 Dec 27 14:21:25.267172 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 23/49] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Dec 27 14:21:22 2021] POST /compute/v2.1/servers => generated 383 bytes in 3246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 27 14:21:25.285357 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3f562cbd-dbe5-49c0-88be-55e7ce24a3ad tempest-VolumesTestJSON-1834280203 tempest-VolumesTestJSON-1834280203-project] Calling method '.version_select at 0x7f8028fced30>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:25.618163 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0a1ff5c9-f8be-4d86-bbb4-c94ab705704e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:25.638992 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0a1ff5c9-f8be-4d86-bbb4-c94ab705704e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1318 microversion: 2.1 time: 0.806440 Dec 27 14:21:25.652350 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 27/50] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:24 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1318 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:25.675668 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fb0e542a-c2db-4556-ab93-b59c039d1a52 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:25.677943 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fb0e542a-c2db-4556-ab93-b59c039d1a52 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:25.698919 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fb0e542a-c2db-4556-ab93-b59c039d1a52 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:25.700200 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fb0e542a-c2db-4556-ab93-b59c039d1a52 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:25.706834 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3f562cbd-dbe5-49c0-88be-55e7ce24a3ad tempest-VolumesTestJSON-1834280203 tempest-VolumesTestJSON-1834280203-project] 10.222.0.37 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.437562 Dec 27 14:21:25.707405 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 24/51] 10.222.0.37 () {58 vars in 1166 bytes} [Mon Dec 27 14:21:25 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:25.716891 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fb0e542a-c2db-4556-ab93-b59c039d1a52 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:25.717399 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fb0e542a-c2db-4556-ab93-b59c039d1a52 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:25.718188 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a02a74db-3100-45cf-83d3-8763b9df13b8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:25.718859 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a02a74db-3100-45cf-83d3-8763b9df13b8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:26.647264 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a02a74db-3100-45cf-83d3-8763b9df13b8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:26.660020 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a02a74db-3100-45cf-83d3-8763b9df13b8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1221 microversion: 2.1 time: 0.950579 Dec 27 14:21:26.665813 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 25/52] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:25 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1221 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:26.730611 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-258700e5-856f-4e99-a744-619dc5479c64 tempest-VolumesTestJSON-1834280203 tempest-VolumesTestJSON-1834280203-project] Calling method '.version_select at 0x7f8028fb5310>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:27.033788 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-258700e5-856f-4e99-a744-619dc5479c64 tempest-VolumesTestJSON-1834280203 tempest-VolumesTestJSON-1834280203-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.360982 Dec 27 14:21:27.043712 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 26/53] 10.222.0.37 () {58 vars in 1169 bytes} [Mon Dec 27 14:21:26 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:27.048542 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b2a5dae4-4efa-416a-9c61-ddffb9f5e5ca tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:27.049169 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b2a5dae4-4efa-416a-9c61-ddffb9f5e5ca tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:27.074872 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b2a5dae4-4efa-416a-9c61-ddffb9f5e5ca tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:27.075563 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b2a5dae4-4efa-416a-9c61-ddffb9f5e5ca tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:27.076587 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b2a5dae4-4efa-416a-9c61-ddffb9f5e5ca tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:27.077177 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b2a5dae4-4efa-416a-9c61-ddffb9f5e5ca tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:27.715111 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-fb0e542a-c2db-4556-ab93-b59c039d1a52 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:27.726915 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fb0e542a-c2db-4556-ab93-b59c039d1a52 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1315 microversion: 2.1 time: 2.071830 Dec 27 14:21:27.730697 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 28/54] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:25 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1315 bytes in 2078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:27.739378 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ea65a8f4-55b1-4b9f-978f-b4d315834e00 tempest-VolumesTestJSON-1834280203 tempest-VolumesTestJSON-1834280203-project] Calling method '.version_select at 0x7f8028fc6e50>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:28.007817 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ea65a8f4-55b1-4b9f-978f-b4d315834e00 tempest-VolumesTestJSON-1834280203 tempest-VolumesTestJSON-1834280203-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.275543 Dec 27 14:21:28.015537 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 29/55] 10.222.0.37 () {58 vars in 1154 bytes} [Mon Dec 27 14:21:27 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:28.027068 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3a81f5a4-83d3-4283-b6e7-754b97d5324f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1802682470", "imageRef": "c8bd383f-96c5-4e2b-aaa5-fabd68b307f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d69ed432-f936-4488-b3c6-1b0b85e4dc0f"}]}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:21:28.205389 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.network.neutron [None req-3a81f5a4-83d3-4283-b6e7-754b97d5324f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] validate_networks() for [('d69ed432-f936-4488-b3c6-1b0b85e4dc0f', None, None, None, None, None)] {{(pid=116105) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 27 14:21:28.723758 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b2a5dae4-4efa-416a-9c61-ddffb9f5e5ca tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:28.743028 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b2a5dae4-4efa-416a-9c61-ddffb9f5e5ca tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1318 microversion: 2.1 time: 1.696203 Dec 27 14:21:28.744756 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 27/56] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:27 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1318 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:28.763669 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e9c6f8a7-37d0-480b-8f10-faddb0b1e698 tempest-VolumesTestJSON-1834280203 tempest-VolumesTestJSON-1834280203-project] Calling method '.version_select at 0x7f8028f6bd30>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:29.066167 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e9c6f8a7-37d0-480b-8f10-faddb0b1e698 tempest-VolumesTestJSON-1834280203 tempest-VolumesTestJSON-1834280203-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.318941 Dec 27 14:21:29.066978 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 28/57] 10.222.0.37 () {58 vars in 1187 bytes} [Mon Dec 27 14:21:28 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:29.078497 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c1b9644e-d30b-4bfa-a216-922c9cddaa9f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:29.080016 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c1b9644e-d30b-4bfa-a216-922c9cddaa9f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:29.124467 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1b9644e-d30b-4bfa-a216-922c9cddaa9f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:29.126241 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1b9644e-d30b-4bfa-a216-922c9cddaa9f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:29.128425 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1b9644e-d30b-4bfa-a216-922c9cddaa9f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:29.132699 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1b9644e-d30b-4bfa-a216-922c9cddaa9f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:30.108609 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c1b9644e-d30b-4bfa-a216-922c9cddaa9f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:30.128139 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c1b9644e-d30b-4bfa-a216-922c9cddaa9f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1315 microversion: 2.1 time: 1.058439 Dec 27 14:21:30.130885 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 29/58] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:29 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1315 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:30.154645 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f80e3551-6792-4a0d-91b4-5169ba40d0c6 tempest-VolumesTestJSON-1834280203 tempest-VolumesTestJSON-1834280203-project] Calling method '.version_select at 0x7f8028fceaf0>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:30.644377 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f80e3551-6792-4a0d-91b4-5169ba40d0c6 tempest-VolumesTestJSON-1834280203 tempest-VolumesTestJSON-1834280203-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.511189 Dec 27 14:21:30.644956 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 30/59] 10.222.0.37 () {58 vars in 1154 bytes} [Mon Dec 27 14:21:30 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:30.650245 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-64941066-965e-443a-923b-b20f6d44b855 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:30.651638 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-64941066-965e-443a-923b-b20f6d44b855 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:30.681661 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-64941066-965e-443a-923b-b20f6d44b855 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:30.681755 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-64941066-965e-443a-923b-b20f6d44b855 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:30.698899 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-3a81f5a4-83d3-4283-b6e7-754b97d5324f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Flavor limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 27 14:21:30.701081 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-3a81f5a4-83d3-4283-b6e7-754b97d5324f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Image limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 27 14:21:30.701668 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-3a81f5a4-83d3-4283-b6e7-754b97d5324f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Flavor pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 27 14:21:30.702107 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-3a81f5a4-83d3-4283-b6e7-754b97d5324f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Image pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 27 14:21:30.702547 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-3a81f5a4-83d3-4283-b6e7-754b97d5324f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 27 14:21:30.724111 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-64941066-965e-443a-923b-b20f6d44b855 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:30.728140 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-64941066-965e-443a-923b-b20f6d44b855 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.042s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:30.748638 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a81f5a4-83d3-4283-b6e7-754b97d5324f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:30.749621 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a81f5a4-83d3-4283-b6e7-754b97d5324f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:30.752885 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a81f5a4-83d3-4283-b6e7-754b97d5324f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:30.753590 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a81f5a4-83d3-4283-b6e7-754b97d5324f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:30.814784 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-3a81f5a4-83d3-4283-b6e7-754b97d5324f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Getting quotas for project 5516ca8550bb4056a7966db3f506971b. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:21:30.827971 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-3a81f5a4-83d3-4283-b6e7-754b97d5324f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Getting quotas for user 58ff109f2ce44078a5cd96cc901ffcdd and project 5516ca8550bb4056a7966db3f506971b. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:21:30.904791 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3a81f5a4-83d3-4283-b6e7-754b97d5324f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Going to run 1 instances... {{(pid=116105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 27 14:21:30.908249 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3a81f5a4-83d3-4283-b6e7-754b97d5324f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c8bd383f-96c5-4e2b-aaa5-fabd68b307f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 27 14:21:31.084342 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3a81f5a4-83d3-4283-b6e7-754b97d5324f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.062540 Dec 27 14:21:31.085758 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 30/60] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Dec 27 14:21:28 2021] POST /compute/v2.1/servers => generated 383 bytes in 3070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 27 14:21:31.109754 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4e71a523-7f83-4bb8-9fc4-b0fb191bd806 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-225971261", "imageRef": "c8bd383f-96c5-4e2b-aaa5-fabd68b307f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "67a7decc-c7a3-4b69-8e7b-3eb61e173248"}], "security_groups": [{"name": "tempest-securitygroup--807766550"}], "key_name": "tempest-keypair-1427882894", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:21:32.231447 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-64941066-965e-443a-923b-b20f6d44b855 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:32.248901 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-64941066-965e-443a-923b-b20f6d44b855 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1318 microversion: 2.1 time: 1.601932 Dec 27 14:21:32.260367 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 31/61] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:30 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1318 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:32.294904 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bce01401-1be6-4435-b4e6-6d00d046e85e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:32.299916 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bce01401-1be6-4435-b4e6-6d00d046e85e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:32.331009 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bce01401-1be6-4435-b4e6-6d00d046e85e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:32.332923 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bce01401-1be6-4435-b4e6-6d00d046e85e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:32.334231 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bce01401-1be6-4435-b4e6-6d00d046e85e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:32.334807 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bce01401-1be6-4435-b4e6-6d00d046e85e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:32.814762 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.network.neutron [None req-4e71a523-7f83-4bb8-9fc4-b0fb191bd806 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] validate_networks() for [('67a7decc-c7a3-4b69-8e7b-3eb61e173248', None, None, None, None, None)] {{(pid=116105) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 27 14:21:32.865199 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bce01401-1be6-4435-b4e6-6d00d046e85e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:32.881159 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bce01401-1be6-4435-b4e6-6d00d046e85e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1226 microversion: 2.1 time: 0.600503 Dec 27 14:21:32.881934 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 32/62] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:32 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1226 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:32.894627 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-32a0d3f5-59f6-4a85-a65d-5d32ec27a146 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:32.895799 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-32a0d3f5-59f6-4a85-a65d-5d32ec27a146 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:32.903983 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32a0d3f5-59f6-4a85-a65d-5d32ec27a146 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:32.904612 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32a0d3f5-59f6-4a85-a65d-5d32ec27a146 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:32.905712 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32a0d3f5-59f6-4a85-a65d-5d32ec27a146 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:32.906298 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32a0d3f5-59f6-4a85-a65d-5d32ec27a146 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:33.137129 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-32a0d3f5-59f6-4a85-a65d-5d32ec27a146 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:33.148624 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-32a0d3f5-59f6-4a85-a65d-5d32ec27a146 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1315 microversion: 2.1 time: 0.264482 Dec 27 14:21:33.149199 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 33/63] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:32 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:33.368776 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-f6f7f896-0669-4582-8726-47d67fe5a0db req-08e1df56-2de9-4175-bc9a-a1c40ced49c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9183a2b5-fbe1-45df-906b-e7311f3a3826", "tag": "5f034588-3141-4425-885f-1e0f76e6fb2a"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:21:33.372552 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:21:33.372552 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:21:33.399757 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-f6f7f896-0669-4582-8726-47d67fe5a0db req-08e1df56-2de9-4175-bc9a-a1c40ced49c4 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:33.401267 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-f6f7f896-0669-4582-8726-47d67fe5a0db req-08e1df56-2de9-4175-bc9a-a1c40ced49c4 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:33.439268 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-f6f7f896-0669-4582-8726-47d67fe5a0db req-08e1df56-2de9-4175-bc9a-a1c40ced49c4 service nova] Creating event network-changed:5f034588-3141-4425-885f-1e0f76e6fb2a for instance 9183a2b5-fbe1-45df-906b-e7311f3a3826 on hv-cinder-82301 Dec 27 14:21:33.441492 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-f6f7f896-0669-4582-8726-47d67fe5a0db req-08e1df56-2de9-4175-bc9a-a1c40ced49c4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116104) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 27 14:21:33.446361 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-92aaf549-c60b-472e-a04a-f9828b25802c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:33.449008 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-92aaf549-c60b-472e-a04a-f9828b25802c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:33.453411 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-92aaf549-c60b-472e-a04a-f9828b25802c None None] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:33.454027 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-92aaf549-c60b-472e-a04a-f9828b25802c None None] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:33.465504 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.compute.rpcapi [None req-92aaf549-c60b-472e-a04a-f9828b25802c None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 27 14:21:33.466503 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-92aaf549-c60b-472e-a04a-f9828b25802c None None] Releasing lock "compute-rpcapi-router" {{(pid=116104) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 27 14:21:33.504086 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-92aaf549-c60b-472e-a04a-f9828b25802c None None] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.352261 Dec 27 14:21:33.505590 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 34/64] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:21:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:33.612326 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-ac0b59d4-e0b9-4c61-be6d-f74c90356405 req-1709fad6-5acf-43f8-b9af-f6eda35d667d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1a23bf5-4a73-4f6b-97ba-2426322d63b1", "tag": "839d0ed8-92c5-497f-a22d-8fe95743ee6c"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:21:33.614124 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:21:33.614124 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:21:33.635116 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-ac0b59d4-e0b9-4c61-be6d-f74c90356405 req-1709fad6-5acf-43f8-b9af-f6eda35d667d service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:33.636697 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-ac0b59d4-e0b9-4c61-be6d-f74c90356405 req-1709fad6-5acf-43f8-b9af-f6eda35d667d service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:33.664320 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-ac0b59d4-e0b9-4c61-be6d-f74c90356405 req-1709fad6-5acf-43f8-b9af-f6eda35d667d service nova] Creating event network-changed:839d0ed8-92c5-497f-a22d-8fe95743ee6c for instance c1a23bf5-4a73-4f6b-97ba-2426322d63b1 on hv-cinder-82301 Dec 27 14:21:33.674119 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-ac0b59d4-e0b9-4c61-be6d-f74c90356405 req-1709fad6-5acf-43f8-b9af-f6eda35d667d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166589 Dec 27 14:21:33.677532 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 35/65] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:21:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:33.690649 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3c0395c8-99cf-46dc-b853-a273e2ffe883 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:33.690845 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3c0395c8-99cf-46dc-b853-a273e2ffe883 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:33.711621 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3c0395c8-99cf-46dc-b853-a273e2ffe883 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:33.712115 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3c0395c8-99cf-46dc-b853-a273e2ffe883 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:33.712924 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3c0395c8-99cf-46dc-b853-a273e2ffe883 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:33.713370 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3c0395c8-99cf-46dc-b853-a273e2ffe883 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:33.815713 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-4e71a523-7f83-4bb8-9fc4-b0fb191bd806 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Flavor limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 27 14:21:33.816313 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-4e71a523-7f83-4bb8-9fc4-b0fb191bd806 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Image limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 27 14:21:33.816911 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-4e71a523-7f83-4bb8-9fc4-b0fb191bd806 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Flavor pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 27 14:21:33.817998 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-4e71a523-7f83-4bb8-9fc4-b0fb191bd806 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Image pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 27 14:21:33.818479 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-4e71a523-7f83-4bb8-9fc4-b0fb191bd806 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 27 14:21:33.851310 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4e71a523-7f83-4bb8-9fc4-b0fb191bd806 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:33.852248 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4e71a523-7f83-4bb8-9fc4-b0fb191bd806 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:33.853439 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4e71a523-7f83-4bb8-9fc4-b0fb191bd806 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:33.853974 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4e71a523-7f83-4bb8-9fc4-b0fb191bd806 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:33.876397 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-4e71a523-7f83-4bb8-9fc4-b0fb191bd806 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Getting quotas for project 3987a0b7a4764509990d2849d59e6238. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:21:33.881305 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-4e71a523-7f83-4bb8-9fc4-b0fb191bd806 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Getting quotas for user 4c8987f7dafc41f999a222eb0145ae95 and project 3987a0b7a4764509990d2849d59e6238. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:21:33.950975 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4e71a523-7f83-4bb8-9fc4-b0fb191bd806 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Going to run 1 instances... {{(pid=116105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 27 14:21:33.960450 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3c0395c8-99cf-46dc-b853-a273e2ffe883 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:33.962997 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4e71a523-7f83-4bb8-9fc4-b0fb191bd806 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c8bd383f-96c5-4e2b-aaa5-fabd68b307f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 27 14:21:33.977631 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3c0395c8-99cf-46dc-b853-a273e2ffe883 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1318 microversion: 2.1 time: 0.298657 Dec 27 14:21:33.989042 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 36/66] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:33 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:33.994265 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-574bdf37-5027-4153-95b8-d88d310d09b4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:33.996264 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-574bdf37-5027-4153-95b8-d88d310d09b4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:34.004832 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-574bdf37-5027-4153-95b8-d88d310d09b4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:34.005673 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-574bdf37-5027-4153-95b8-d88d310d09b4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:34.006913 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-574bdf37-5027-4153-95b8-d88d310d09b4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:34.007658 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-574bdf37-5027-4153-95b8-d88d310d09b4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:34.099375 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4e71a523-7f83-4bb8-9fc4-b0fb191bd806 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.009366 Dec 27 14:21:34.100506 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 31/67] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Dec 27 14:21:31 2021] POST /compute/v2.1/servers => generated 401 bytes in 3013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 27 14:21:34.119425 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-96c0e16b-0f14-474a-ab6b-d2b9b655a0be tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:34.119425 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-96c0e16b-0f14-474a-ab6b-d2b9b655a0be tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:34.120690 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-574bdf37-5027-4153-95b8-d88d310d09b4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:34.129603 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-574bdf37-5027-4153-95b8-d88d310d09b4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1218 microversion: 2.1 time: 0.138357 Dec 27 14:21:34.141357 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 37/68] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:33 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1218 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:34.170847 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e1c6889b-3c0c-4d81-9a0b-38de70a3a5ac tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:34.171473 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e1c6889b-3c0c-4d81-9a0b-38de70a3a5ac tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:34.189830 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1c6889b-3c0c-4d81-9a0b-38de70a3a5ac tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:34.190298 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1c6889b-3c0c-4d81-9a0b-38de70a3a5ac tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:34.191125 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1c6889b-3c0c-4d81-9a0b-38de70a3a5ac tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:34.200376 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1c6889b-3c0c-4d81-9a0b-38de70a3a5ac tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:34.242118 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-96c0e16b-0f14-474a-ab6b-d2b9b655a0be tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:34.255219 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-96c0e16b-0f14-474a-ab6b-d2b9b655a0be tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1237 microversion: 2.1 time: 0.147138 Dec 27 14:21:34.258669 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 32/69] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:34 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1237 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:34.534622 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e1c6889b-3c0c-4d81-9a0b-38de70a3a5ac tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:34.546457 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e1c6889b-3c0c-4d81-9a0b-38de70a3a5ac tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1315 microversion: 2.1 time: 0.381975 Dec 27 14:21:34.546457 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 38/70] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:34 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:34.997273 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-066b0485-a9a4-4b17-bc75-62762c936fd0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:34.997888 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-066b0485-a9a4-4b17-bc75-62762c936fd0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:35.004558 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-066b0485-a9a4-4b17-bc75-62762c936fd0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:35.005008 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-066b0485-a9a4-4b17-bc75-62762c936fd0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:35.005789 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-066b0485-a9a4-4b17-bc75-62762c936fd0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:35.006223 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-066b0485-a9a4-4b17-bc75-62762c936fd0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:35.142909 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-066b0485-a9a4-4b17-bc75-62762c936fd0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:35.147815 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7166388b-a1ab-4b8a-bbb7-4fdc37792956 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:35.148693 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7166388b-a1ab-4b8a-bbb7-4fdc37792956 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:35.155451 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-066b0485-a9a4-4b17-bc75-62762c936fd0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1318 microversion: 2.1 time: 0.163305 Dec 27 14:21:35.155640 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7166388b-a1ab-4b8a-bbb7-4fdc37792956 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:35.156065 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 33/71] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:34 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:35.157186 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7166388b-a1ab-4b8a-bbb7-4fdc37792956 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:35.157186 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7166388b-a1ab-4b8a-bbb7-4fdc37792956 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:35.157614 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7166388b-a1ab-4b8a-bbb7-4fdc37792956 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:35.220034 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7166388b-a1ab-4b8a-bbb7-4fdc37792956 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:35.228215 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7166388b-a1ab-4b8a-bbb7-4fdc37792956 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1218 microversion: 2.1 time: 0.084148 Dec 27 14:21:35.229041 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 39/72] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:35 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:21:35.273191 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-64dc912b-8565-4653-a71d-b610cb1c3d2d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:35.273796 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-64dc912b-8565-4653-a71d-b610cb1c3d2d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:35.280092 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-64dc912b-8565-4653-a71d-b610cb1c3d2d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:35.280585 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-64dc912b-8565-4653-a71d-b610cb1c3d2d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:35.282339 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-64dc912b-8565-4653-a71d-b610cb1c3d2d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:35.282662 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-64dc912b-8565-4653-a71d-b610cb1c3d2d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:35.367118 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-64dc912b-8565-4653-a71d-b610cb1c3d2d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:35.377576 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-64dc912b-8565-4653-a71d-b610cb1c3d2d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1241 microversion: 2.1 time: 0.107339 Dec 27 14:21:35.388116 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 34/73] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:35 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1241 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:35.562245 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e8057202-0a2a-4d4a-a684-b2fc674a8c05 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:35.563618 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e8057202-0a2a-4d4a-a684-b2fc674a8c05 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:35.570387 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8057202-0a2a-4d4a-a684-b2fc674a8c05 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:35.571080 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8057202-0a2a-4d4a-a684-b2fc674a8c05 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:35.572175 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8057202-0a2a-4d4a-a684-b2fc674a8c05 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:35.572620 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8057202-0a2a-4d4a-a684-b2fc674a8c05 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:35.716249 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e8057202-0a2a-4d4a-a684-b2fc674a8c05 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:35.723701 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e8057202-0a2a-4d4a-a684-b2fc674a8c05 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1315 microversion: 2.1 time: 0.166469 Dec 27 14:21:35.733709 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 40/74] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:35 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:36.173961 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e4fbaaa4-da98-42c5-bd58-e93bd5b580df tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:36.174785 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e4fbaaa4-da98-42c5-bd58-e93bd5b580df tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:36.180974 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e4fbaaa4-da98-42c5-bd58-e93bd5b580df tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:36.181423 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e4fbaaa4-da98-42c5-bd58-e93bd5b580df tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:36.182254 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e4fbaaa4-da98-42c5-bd58-e93bd5b580df tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:36.182800 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e4fbaaa4-da98-42c5-bd58-e93bd5b580df tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:36.246220 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-efa2776f-c610-4f0f-b865-8f550a0ad530 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:36.246852 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-efa2776f-c610-4f0f-b865-8f550a0ad530 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:36.252813 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-efa2776f-c610-4f0f-b865-8f550a0ad530 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:36.253365 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-efa2776f-c610-4f0f-b865-8f550a0ad530 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:36.254320 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-efa2776f-c610-4f0f-b865-8f550a0ad530 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:36.254931 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-efa2776f-c610-4f0f-b865-8f550a0ad530 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:36.328488 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e4fbaaa4-da98-42c5-bd58-e93bd5b580df tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:36.336468 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e4fbaaa4-da98-42c5-bd58-e93bd5b580df tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1318 microversion: 2.1 time: 0.166245 Dec 27 14:21:36.337040 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 35/75] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:36 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:36.346321 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-efa2776f-c610-4f0f-b865-8f550a0ad530 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:36.353824 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-efa2776f-c610-4f0f-b865-8f550a0ad530 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1218 microversion: 2.1 time: 0.112390 Dec 27 14:21:36.355001 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 41/76] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:36 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:21:36.394278 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9f170144-0275-4d8d-b0b1-a4e06302eaed tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:36.394982 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9f170144-0275-4d8d-b0b1-a4e06302eaed tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:36.400790 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9f170144-0275-4d8d-b0b1-a4e06302eaed tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:36.401861 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9f170144-0275-4d8d-b0b1-a4e06302eaed tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:36.402784 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9f170144-0275-4d8d-b0b1-a4e06302eaed tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:36.403224 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9f170144-0275-4d8d-b0b1-a4e06302eaed tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:36.465478 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9f170144-0275-4d8d-b0b1-a4e06302eaed tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:36.472774 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9f170144-0275-4d8d-b0b1-a4e06302eaed tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1241 microversion: 2.1 time: 0.082303 Dec 27 14:21:36.473327 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 36/77] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:36 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:36.740321 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b50d75b2-b34b-4bd0-a435-400626bd8dc3 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:36.740866 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b50d75b2-b34b-4bd0-a435-400626bd8dc3 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:36.746823 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b50d75b2-b34b-4bd0-a435-400626bd8dc3 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:36.747275 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b50d75b2-b34b-4bd0-a435-400626bd8dc3 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:36.748091 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b50d75b2-b34b-4bd0-a435-400626bd8dc3 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:36.748530 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b50d75b2-b34b-4bd0-a435-400626bd8dc3 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:36.848855 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-534f6355-b493-4664-bcb1-42465c18fde3 tempest-VolumesNegativeTest-1053604915 tempest-VolumesNegativeTest-1053604915-project] Action: 'create', calling method: .version_select at 0x7f8028f97c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1044436194", "metadata": {"Type": "work"}}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:21:36.850435 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-534f6355-b493-4664-bcb1-42465c18fde3 tempest-VolumesNegativeTest-1053604915 tempest-VolumesNegativeTest-1053604915-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:21:36.851231 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-534f6355-b493-4664-bcb1-42465c18fde3 tempest-VolumesNegativeTest-1053604915 tempest-VolumesNegativeTest-1053604915-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.138052 Dec 27 14:21:36.851753 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 42/78] 10.222.0.37 () {60 vars in 1155 bytes} [Mon Dec 27 14:21:36 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 27 14:21:36.861039 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7fb97324-20ed-4b64-8ca7-a4bd94027465 tempest-VolumesNegativeTest-1053604915 tempest-VolumesNegativeTest-1053604915-project] Action: 'create', calling method: .version_select at 0x7f8028f6b790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2071948948", "metadata": {"Type": "work"}}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:21:36.862220 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7fb97324-20ed-4b64-8ca7-a4bd94027465 tempest-VolumesNegativeTest-1053604915 tempest-VolumesNegativeTest-1053604915-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:21:36.862995 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7fb97324-20ed-4b64-8ca7-a4bd94027465 tempest-VolumesNegativeTest-1053604915 tempest-VolumesNegativeTest-1053604915-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.005468 Dec 27 14:21:36.864905 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 43/79] 10.222.0.37 () {60 vars in 1155 bytes} [Mon Dec 27 14:21:36 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 27 14:21:36.873144 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8d572e08-83cd-4e13-8287-9ad3735500d9 tempest-VolumesNegativeTest-1053604915 tempest-VolumesNegativeTest-1053604915-project] Action: 'create', calling method: .version_select at 0x7f802985e1f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-162434119", "metadata": {"Type": "work"}}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:21:36.874338 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8d572e08-83cd-4e13-8287-9ad3735500d9 tempest-VolumesNegativeTest-1053604915 tempest-VolumesNegativeTest-1053604915-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:21:36.875144 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8d572e08-83cd-4e13-8287-9ad3735500d9 tempest-VolumesNegativeTest-1053604915 tempest-VolumesNegativeTest-1053604915-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006833 Dec 27 14:21:36.875674 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 44/80] 10.222.0.37 () {60 vars in 1155 bytes} [Mon Dec 27 14:21:36 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 27 14:21:36.884675 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7073d740-e801-4044-b44d-128395da5ed1 tempest-VolumesNegativeTest-1053604915 tempest-VolumesNegativeTest-1053604915-project] Calling method '.version_select at 0x7f8028f97f70>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:36.891106 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b50d75b2-b34b-4bd0-a435-400626bd8dc3 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:36.899316 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b50d75b2-b34b-4bd0-a435-400626bd8dc3 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1315 microversion: 2.1 time: 0.162520 Dec 27 14:21:36.909389 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 37/81] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:36 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:21:36.922049 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-7073d740-e801-4044-b44d-128395da5ed1 tempest-VolumesNegativeTest-1053604915 tempest-VolumesNegativeTest-1053604915-project] HTTP exception thrown: Volume tempest-invalid-1886759796 could not be found. Dec 27 14:21:36.922723 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7073d740-e801-4044-b44d-128395da5ed1 tempest-VolumesNegativeTest-1053604915 tempest-VolumesNegativeTest-1053604915-project] Returning 404 to user: Volume tempest-invalid-1886759796 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:21:36.923770 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7073d740-e801-4044-b44d-128395da5ed1 tempest-VolumesNegativeTest-1053604915 tempest-VolumesNegativeTest-1053604915-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1886759796" status: 404 len: 99 microversion: 2.1 time: 0.042521 Dec 27 14:21:36.924419 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 45/82] 10.222.0.37 () {58 vars in 1217 bytes} [Mon Dec 27 14:21:36 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1886759796 => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 27 14:21:36.933741 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c9c8aa78-dab7-41e5-8379-b465fb51d956 tempest-VolumesNegativeTest-1053604915 tempest-VolumesNegativeTest-1053604915-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004085 Dec 27 14:21:36.934232 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 38/83] 10.222.0.37 () {58 vars in 1139 bytes} [Mon Dec 27 14:21:36 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 27 14:21:36.942752 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f4bf9ea9-d116-4c95-a65c-aaeed411d410 tempest-VolumesNegativeTest-1053604915 tempest-VolumesNegativeTest-1053604915-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004030 Dec 27 14:21:36.943213 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 46/84] 10.222.0.37 () {58 vars in 1136 bytes} [Mon Dec 27 14:21:36 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 27 14:21:36.951399 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0eff9a1b-ccbd-4d04-b256-fe703a7a858c tempest-VolumesNegativeTest-1053604915 tempest-VolumesNegativeTest-1053604915-project] Calling method '.version_select at 0x7f802873f790>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:36.977537 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-0eff9a1b-ccbd-4d04-b256-fe703a7a858c tempest-VolumesNegativeTest-1053604915 tempest-VolumesNegativeTest-1053604915-project] HTTP exception thrown: Volume d377a976-df1f-4724-81dc-ee1a498b2cf9 could not be found. Dec 27 14:21:36.978149 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0eff9a1b-ccbd-4d04-b256-fe703a7a858c tempest-VolumesNegativeTest-1053604915 tempest-VolumesNegativeTest-1053604915-project] Returning 404 to user: Volume d377a976-df1f-4724-81dc-ee1a498b2cf9 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:21:36.979510 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0eff9a1b-ccbd-4d04-b256-fe703a7a858c tempest-VolumesNegativeTest-1053604915 tempest-VolumesNegativeTest-1053604915-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/d377a976-df1f-4724-81dc-ee1a498b2cf9" status: 404 len: 109 microversion: 2.1 time: 0.031501 Dec 27 14:21:36.980089 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 39/85] 10.222.0.37 () {58 vars in 1247 bytes} [Mon Dec 27 14:21:36 2021] DELETE /compute/v2.1/os-volumes/d377a976-df1f-4724-81dc-ee1a498b2cf9 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:21:36.988948 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3965fc7c-5b4f-4e49-802e-6064662e4edf tempest-VolumesNegativeTest-1053604915 tempest-VolumesNegativeTest-1053604915-project] Calling method '.version_select at 0x7f8028f97b80>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:37.015530 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-3965fc7c-5b4f-4e49-802e-6064662e4edf tempest-VolumesNegativeTest-1053604915 tempest-VolumesNegativeTest-1053604915-project] HTTP exception thrown: Volume a324314e-95c7-4cba-9522-32522e1b8efe could not be found. Dec 27 14:21:37.016236 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3965fc7c-5b4f-4e49-802e-6064662e4edf tempest-VolumesNegativeTest-1053604915 tempest-VolumesNegativeTest-1053604915-project] Returning 404 to user: Volume a324314e-95c7-4cba-9522-32522e1b8efe could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:21:37.017061 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3965fc7c-5b4f-4e49-802e-6064662e4edf tempest-VolumesNegativeTest-1053604915 tempest-VolumesNegativeTest-1053604915-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/a324314e-95c7-4cba-9522-32522e1b8efe" status: 404 len: 109 microversion: 2.1 time: 0.031706 Dec 27 14:21:37.017585 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 47/86] 10.222.0.37 () {58 vars in 1244 bytes} [Mon Dec 27 14:21:36 2021] GET /compute/v2.1/os-volumes/a324314e-95c7-4cba-9522-32522e1b8efe => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:21:37.353358 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-35b3b634-0556-45d4-bb0d-87aeba86e7c5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:37.354145 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-35b3b634-0556-45d4-bb0d-87aeba86e7c5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:37.365297 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-35b3b634-0556-45d4-bb0d-87aeba86e7c5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:37.365297 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-35b3b634-0556-45d4-bb0d-87aeba86e7c5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:37.365297 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-35b3b634-0556-45d4-bb0d-87aeba86e7c5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:37.366033 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-35b3b634-0556-45d4-bb0d-87aeba86e7c5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:37.374322 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cf7be1d2-3181-45f4-bdc5-6b4d57b796e5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:37.374962 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cf7be1d2-3181-45f4-bdc5-6b4d57b796e5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:37.388201 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf7be1d2-3181-45f4-bdc5-6b4d57b796e5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:37.388999 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf7be1d2-3181-45f4-bdc5-6b4d57b796e5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:37.391505 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf7be1d2-3181-45f4-bdc5-6b4d57b796e5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:37.392093 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf7be1d2-3181-45f4-bdc5-6b4d57b796e5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:37.476350 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cf7be1d2-3181-45f4-bdc5-6b4d57b796e5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:37.488218 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cf7be1d2-3181-45f4-bdc5-6b4d57b796e5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1218 microversion: 2.1 time: 0.118325 Dec 27 14:21:37.489094 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 48/87] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:37 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:37.495541 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3e340eba-8cfe-48e6-9065-ec41de1d92b3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:37.496952 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3e340eba-8cfe-48e6-9065-ec41de1d92b3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:37.508175 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e340eba-8cfe-48e6-9065-ec41de1d92b3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:37.508968 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e340eba-8cfe-48e6-9065-ec41de1d92b3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:37.509986 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e340eba-8cfe-48e6-9065-ec41de1d92b3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:37.510920 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e340eba-8cfe-48e6-9065-ec41de1d92b3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:37.541292 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-35b3b634-0556-45d4-bb0d-87aeba86e7c5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:37.559585 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-35b3b634-0556-45d4-bb0d-87aeba86e7c5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1318 microversion: 2.1 time: 0.209427 Dec 27 14:21:37.560596 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 40/88] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:37 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:37.592227 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3e340eba-8cfe-48e6-9065-ec41de1d92b3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:37.599944 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3e340eba-8cfe-48e6-9065-ec41de1d92b3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1241 microversion: 2.1 time: 0.109621 Dec 27 14:21:37.600518 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 49/89] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:37 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1241 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:37.918147 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ec3c6d60-18f1-49c3-8031-06ba9b643380 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:37.918838 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ec3c6d60-18f1-49c3-8031-06ba9b643380 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:37.924695 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ec3c6d60-18f1-49c3-8031-06ba9b643380 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:37.925211 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ec3c6d60-18f1-49c3-8031-06ba9b643380 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:37.926161 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ec3c6d60-18f1-49c3-8031-06ba9b643380 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:37.926574 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ec3c6d60-18f1-49c3-8031-06ba9b643380 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:38.074234 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ec3c6d60-18f1-49c3-8031-06ba9b643380 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:38.082417 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ec3c6d60-18f1-49c3-8031-06ba9b643380 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1315 microversion: 2.1 time: 0.167901 Dec 27 14:21:38.088221 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 41/90] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:37 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:38.506296 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1da36fe4-7f9d-483d-869c-524600df138a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:38.507068 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1da36fe4-7f9d-483d-869c-524600df138a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:38.513134 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1da36fe4-7f9d-483d-869c-524600df138a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:38.513589 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1da36fe4-7f9d-483d-869c-524600df138a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:38.514373 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1da36fe4-7f9d-483d-869c-524600df138a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:38.514807 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1da36fe4-7f9d-483d-869c-524600df138a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:38.577654 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-42212ce3-91b0-4a29-ba74-8f62f3b5152e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:38.578374 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-42212ce3-91b0-4a29-ba74-8f62f3b5152e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:38.585059 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-42212ce3-91b0-4a29-ba74-8f62f3b5152e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:38.585651 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-42212ce3-91b0-4a29-ba74-8f62f3b5152e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:38.586513 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-42212ce3-91b0-4a29-ba74-8f62f3b5152e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:38.587048 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-42212ce3-91b0-4a29-ba74-8f62f3b5152e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:38.597738 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1da36fe4-7f9d-483d-869c-524600df138a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:38.607200 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1da36fe4-7f9d-483d-869c-524600df138a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1218 microversion: 2.1 time: 0.104656 Dec 27 14:21:38.617843 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 50/91] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:38 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:38.624562 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d1ec2a4b-2e30-4fc1-bd7b-581d6c582760 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:38.625951 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d1ec2a4b-2e30-4fc1-bd7b-581d6c582760 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:38.633870 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1ec2a4b-2e30-4fc1-bd7b-581d6c582760 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:38.634859 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1ec2a4b-2e30-4fc1-bd7b-581d6c582760 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:38.636466 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1ec2a4b-2e30-4fc1-bd7b-581d6c582760 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:38.637119 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1ec2a4b-2e30-4fc1-bd7b-581d6c582760 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:38.718611 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d1ec2a4b-2e30-4fc1-bd7b-581d6c582760 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:38.726816 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d1ec2a4b-2e30-4fc1-bd7b-581d6c582760 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1241 microversion: 2.1 time: 0.107611 Dec 27 14:21:38.727397 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 51/92] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:38 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1241 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:38.743948 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-42212ce3-91b0-4a29-ba74-8f62f3b5152e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:38.752883 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-42212ce3-91b0-4a29-ba74-8f62f3b5152e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1318 microversion: 2.1 time: 0.179694 Dec 27 14:21:38.753586 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 42/93] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:38 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:21:39.105959 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3b5bca0a-1345-46c8-a7b7-1f4b943d9ad0 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:39.106905 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3b5bca0a-1345-46c8-a7b7-1f4b943d9ad0 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:39.113141 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b5bca0a-1345-46c8-a7b7-1f4b943d9ad0 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:39.113848 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b5bca0a-1345-46c8-a7b7-1f4b943d9ad0 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:39.114736 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b5bca0a-1345-46c8-a7b7-1f4b943d9ad0 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:39.115394 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b5bca0a-1345-46c8-a7b7-1f4b943d9ad0 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:39.396926 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3b5bca0a-1345-46c8-a7b7-1f4b943d9ad0 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:39.404542 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3b5bca0a-1345-46c8-a7b7-1f4b943d9ad0 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1315 microversion: 2.1 time: 0.303254 Dec 27 14:21:39.405284 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 52/94] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:39 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:39.626507 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-50da5586-87a5-4926-bceb-75aa580d0288 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:39.627113 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-50da5586-87a5-4926-bceb-75aa580d0288 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:39.635026 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-50da5586-87a5-4926-bceb-75aa580d0288 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:39.637535 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-50da5586-87a5-4926-bceb-75aa580d0288 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:39.638504 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-50da5586-87a5-4926-bceb-75aa580d0288 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:39.639098 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-50da5586-87a5-4926-bceb-75aa580d0288 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:39.747869 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ad5303bf-78dc-4af3-be46-6f3995bb6395 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:39.749413 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ad5303bf-78dc-4af3-be46-6f3995bb6395 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:39.759171 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad5303bf-78dc-4af3-be46-6f3995bb6395 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:39.760103 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad5303bf-78dc-4af3-be46-6f3995bb6395 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:39.761294 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad5303bf-78dc-4af3-be46-6f3995bb6395 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:39.762278 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad5303bf-78dc-4af3-be46-6f3995bb6395 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:39.837114 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-50da5586-87a5-4926-bceb-75aa580d0288 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:39.846299 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-50da5586-87a5-4926-bceb-75aa580d0288 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1218 microversion: 2.1 time: 0.224480 Dec 27 14:21:39.856666 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 43/95] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:39 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1218 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:39.861491 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-31b588ae-dd10-474e-8f29-4ddc8742e590 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:39.862364 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-31b588ae-dd10-474e-8f29-4ddc8742e590 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:39.868996 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31b588ae-dd10-474e-8f29-4ddc8742e590 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:39.870218 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31b588ae-dd10-474e-8f29-4ddc8742e590 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:39.871224 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31b588ae-dd10-474e-8f29-4ddc8742e590 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:39.871932 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31b588ae-dd10-474e-8f29-4ddc8742e590 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:39.892168 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ad5303bf-78dc-4af3-be46-6f3995bb6395 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:39.902934 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ad5303bf-78dc-4af3-be46-6f3995bb6395 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1241 microversion: 2.1 time: 0.160947 Dec 27 14:21:39.912961 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 53/96] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:39 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1241 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:40.422864 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5d373f2d-933d-4a56-9ee4-92dca1819f7e tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:40.423638 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5d373f2d-933d-4a56-9ee4-92dca1819f7e tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:40.436647 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5d373f2d-933d-4a56-9ee4-92dca1819f7e tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:40.437916 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5d373f2d-933d-4a56-9ee4-92dca1819f7e tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:40.442729 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5d373f2d-933d-4a56-9ee4-92dca1819f7e tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:40.443791 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5d373f2d-933d-4a56-9ee4-92dca1819f7e tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:40.695790 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-31b588ae-dd10-474e-8f29-4ddc8742e590 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:40.705236 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-31b588ae-dd10-474e-8f29-4ddc8742e590 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1318 microversion: 2.1 time: 0.847226 Dec 27 14:21:40.710104 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 44/97] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:39 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1318 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:40.864435 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6e767412-40d2-4b82-ab30-aaef48396aaa tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:40.865168 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6e767412-40d2-4b82-ab30-aaef48396aaa tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:40.875229 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6e767412-40d2-4b82-ab30-aaef48396aaa tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:40.875717 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6e767412-40d2-4b82-ab30-aaef48396aaa tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:40.877627 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6e767412-40d2-4b82-ab30-aaef48396aaa tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:40.879341 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6e767412-40d2-4b82-ab30-aaef48396aaa tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:40.920403 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5d373f2d-933d-4a56-9ee4-92dca1819f7e tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:40.931825 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5d373f2d-933d-4a56-9ee4-92dca1819f7e tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1315 microversion: 2.1 time: 0.511240 Dec 27 14:21:40.936063 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 54/98] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:40 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:21:40.957342 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7d243037-0151-436a-80a4-09d334c45800 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:40.964160 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7d243037-0151-436a-80a4-09d334c45800 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:40.982885 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7d243037-0151-436a-80a4-09d334c45800 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:40.983481 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7d243037-0151-436a-80a4-09d334c45800 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:40.987667 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7d243037-0151-436a-80a4-09d334c45800 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:40.991075 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7d243037-0151-436a-80a4-09d334c45800 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:41.079436 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6e767412-40d2-4b82-ab30-aaef48396aaa tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:41.090002 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6e767412-40d2-4b82-ab30-aaef48396aaa tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1292 microversion: 2.1 time: 0.229694 Dec 27 14:21:41.099780 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 45/99] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:40 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1292 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:41.257699 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7d243037-0151-436a-80a4-09d334c45800 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:41.268641 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7d243037-0151-436a-80a4-09d334c45800 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1289 microversion: 2.1 time: 0.328402 Dec 27 14:21:41.269931 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 55/100] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:40 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1289 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:41.726274 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ffcff18c-8ea4-48f1-9a42-1202ad124579 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:41.727532 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ffcff18c-8ea4-48f1-9a42-1202ad124579 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:41.737437 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ffcff18c-8ea4-48f1-9a42-1202ad124579 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:41.739132 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ffcff18c-8ea4-48f1-9a42-1202ad124579 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:41.742133 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ffcff18c-8ea4-48f1-9a42-1202ad124579 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:41.742760 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ffcff18c-8ea4-48f1-9a42-1202ad124579 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:41.953013 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-254262e6-8730-49fb-867b-e21c1f77ddfd tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:41.954265 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-254262e6-8730-49fb-867b-e21c1f77ddfd tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:41.967857 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-254262e6-8730-49fb-867b-e21c1f77ddfd tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:41.968653 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-254262e6-8730-49fb-867b-e21c1f77ddfd tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:41.969697 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-254262e6-8730-49fb-867b-e21c1f77ddfd tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:41.970358 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-254262e6-8730-49fb-867b-e21c1f77ddfd tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:42.277327 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-254262e6-8730-49fb-867b-e21c1f77ddfd tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:42.297920 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-254262e6-8730-49fb-867b-e21c1f77ddfd tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1315 microversion: 2.1 time: 0.348337 Dec 27 14:21:42.308430 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 56/101] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:41 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:42.308430 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-841ec4c0-3262-40d3-ab45-b987a5199a11 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:42.308430 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-841ec4c0-3262-40d3-ab45-b987a5199a11 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:42.328430 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-841ec4c0-3262-40d3-ab45-b987a5199a11 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:42.329058 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-841ec4c0-3262-40d3-ab45-b987a5199a11 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:42.330011 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-841ec4c0-3262-40d3-ab45-b987a5199a11 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:42.330597 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-841ec4c0-3262-40d3-ab45-b987a5199a11 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:42.348387 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ffcff18c-8ea4-48f1-9a42-1202ad124579 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:42.365954 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ffcff18c-8ea4-48f1-9a42-1202ad124579 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1318 microversion: 2.1 time: 0.643222 Dec 27 14:21:42.368061 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 46/102] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:41 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1318 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:42.381400 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-f20bb5da-d626-4782-91ff-dfc1c63fea09 req-184e7613-f8db-48fd-814c-b4092bfe4e79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8520422d-f3a9-443c-9e9a-12fb03ef1bcc", "tag": "43013b38-d0e6-4557-ae2b-adff54b730ab"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:21:42.386019 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:21:42.386019 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:21:42.423280 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-f20bb5da-d626-4782-91ff-dfc1c63fea09 req-184e7613-f8db-48fd-814c-b4092bfe4e79 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:42.425346 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-f20bb5da-d626-4782-91ff-dfc1c63fea09 req-184e7613-f8db-48fd-814c-b4092bfe4e79 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:42.474906 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-f20bb5da-d626-4782-91ff-dfc1c63fea09 req-184e7613-f8db-48fd-814c-b4092bfe4e79 service nova] Creating event network-changed:43013b38-d0e6-4557-ae2b-adff54b730ab for instance 8520422d-f3a9-443c-9e9a-12fb03ef1bcc on hv-cinder-82301 Dec 27 14:21:42.479503 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-f20bb5da-d626-4782-91ff-dfc1c63fea09 req-184e7613-f8db-48fd-814c-b4092bfe4e79 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116105) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 27 14:21:42.494261 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3265e25f-40cc-402b-b06e-99b15f2dada2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:42.494261 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3265e25f-40cc-402b-b06e-99b15f2dada2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:42.494261 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3265e25f-40cc-402b-b06e-99b15f2dada2 None None] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:42.494261 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3265e25f-40cc-402b-b06e-99b15f2dada2 None None] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:42.506966 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.compute.rpcapi [None req-3265e25f-40cc-402b-b06e-99b15f2dada2 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 27 14:21:42.508574 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3265e25f-40cc-402b-b06e-99b15f2dada2 None None] Releasing lock "compute-rpcapi-router" {{(pid=116105) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 27 14:21:42.512941 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-841ec4c0-3262-40d3-ab45-b987a5199a11 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:42.524725 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-841ec4c0-3262-40d3-ab45-b987a5199a11 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1280 microversion: 2.1 time: 0.224139 Dec 27 14:21:42.525213 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 57/103] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:42 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1280 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:42.542044 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3265e25f-40cc-402b-b06e-99b15f2dada2 None None] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170605 Dec 27 14:21:42.542727 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-721ab49f-30d7-4ab5-8edd-acad40c4a93a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:42.542978 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 47/104] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:21:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:42.543347 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-721ab49f-30d7-4ab5-8edd-acad40c4a93a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:42.571315 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-721ab49f-30d7-4ab5-8edd-acad40c4a93a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:42.574774 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-721ab49f-30d7-4ab5-8edd-acad40c4a93a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:42.577199 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-721ab49f-30d7-4ab5-8edd-acad40c4a93a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:42.577814 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-721ab49f-30d7-4ab5-8edd-acad40c4a93a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:42.716146 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-721ab49f-30d7-4ab5-8edd-acad40c4a93a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:42.726453 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-721ab49f-30d7-4ab5-8edd-acad40c4a93a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1295 microversion: 2.1 time: 0.193676 Dec 27 14:21:42.727035 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 58/105] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:42 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1295 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:43.317136 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-04130a19-135f-487f-b904-0341d214263c tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:43.318000 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-04130a19-135f-487f-b904-0341d214263c tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:43.328199 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-04130a19-135f-487f-b904-0341d214263c tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:43.329255 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-04130a19-135f-487f-b904-0341d214263c tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:43.332383 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-04130a19-135f-487f-b904-0341d214263c tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:43.333341 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-04130a19-135f-487f-b904-0341d214263c tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:43.390831 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-857cb883-3602-4ca0-a3b6-e1269495a172 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:43.393859 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-857cb883-3602-4ca0-a3b6-e1269495a172 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:43.408585 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-857cb883-3602-4ca0-a3b6-e1269495a172 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:43.409698 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-857cb883-3602-4ca0-a3b6-e1269495a172 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:43.410583 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-857cb883-3602-4ca0-a3b6-e1269495a172 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:43.411488 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-857cb883-3602-4ca0-a3b6-e1269495a172 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:43.676489 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-857cb883-3602-4ca0-a3b6-e1269495a172 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:43.686395 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-857cb883-3602-4ca0-a3b6-e1269495a172 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1318 microversion: 2.1 time: 0.304534 Dec 27 14:21:43.687065 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 59/106] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:43 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:43.691958 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1fa61481-af02-4df6-ba11-d77e190f0a04 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:43.693137 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1fa61481-af02-4df6-ba11-d77e190f0a04 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:43.701534 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1fa61481-af02-4df6-ba11-d77e190f0a04 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:43.702328 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1fa61481-af02-4df6-ba11-d77e190f0a04 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:43.703640 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1fa61481-af02-4df6-ba11-d77e190f0a04 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:43.704453 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1fa61481-af02-4df6-ba11-d77e190f0a04 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:43.804361 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1fa61481-af02-4df6-ba11-d77e190f0a04 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:43.814957 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1fa61481-af02-4df6-ba11-d77e190f0a04 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1280 microversion: 2.1 time: 0.126398 Dec 27 14:21:43.815875 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 60/107] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:43 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1280 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:43.824258 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f6ec5481-822d-4798-aea8-eec256aff02d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:43.828169 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f6ec5481-822d-4798-aea8-eec256aff02d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:43.843877 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f6ec5481-822d-4798-aea8-eec256aff02d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:43.844470 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f6ec5481-822d-4798-aea8-eec256aff02d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:43.845631 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f6ec5481-822d-4798-aea8-eec256aff02d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:43.846375 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f6ec5481-822d-4798-aea8-eec256aff02d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:43.854442 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-04130a19-135f-487f-b904-0341d214263c tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:43.868172 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-04130a19-135f-487f-b904-0341d214263c tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1315 microversion: 2.1 time: 0.554170 Dec 27 14:21:43.876631 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 48/108] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:43 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:44.217785 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-8d1612d0-4144-4974-a217-dbf123a721a3 req-2041bd5b-355b-4f60-bce1-4463bf31242e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f72aa5e-493b-4d61-87f7-7da3af1ab7f4", "tag": "59b42668-caea-412a-a372-6451c4f609df"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:21:44.219780 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:21:44.219780 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:21:44.227136 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-8d1612d0-4144-4974-a217-dbf123a721a3 req-2041bd5b-355b-4f60-bce1-4463bf31242e service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:44.227872 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-8d1612d0-4144-4974-a217-dbf123a721a3 req-2041bd5b-355b-4f60-bce1-4463bf31242e service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:44.250612 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-8d1612d0-4144-4974-a217-dbf123a721a3 req-2041bd5b-355b-4f60-bce1-4463bf31242e service nova] Creating event network-changed:59b42668-caea-412a-a372-6451c4f609df for instance 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 on hv-cinder-82301 Dec 27 14:21:44.260692 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-8d1612d0-4144-4974-a217-dbf123a721a3 req-2041bd5b-355b-4f60-bce1-4463bf31242e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047646 Dec 27 14:21:44.261883 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 49/109] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:21:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:44.453433 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f6ec5481-822d-4798-aea8-eec256aff02d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:44.461044 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f6ec5481-822d-4798-aea8-eec256aff02d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1362 microversion: 2.1 time: 0.643758 Dec 27 14:21:44.480218 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 61/110] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:43 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1362 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:44.704899 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b9c8ff4c-5d53-4431-b5ee-58b30e03ddea tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:44.705787 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b9c8ff4c-5d53-4431-b5ee-58b30e03ddea tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:44.712014 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b9c8ff4c-5d53-4431-b5ee-58b30e03ddea tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:44.720863 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b9c8ff4c-5d53-4431-b5ee-58b30e03ddea tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:44.721940 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b9c8ff4c-5d53-4431-b5ee-58b30e03ddea tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:44.722533 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b9c8ff4c-5d53-4431-b5ee-58b30e03ddea tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:44.833406 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7f5ed9ad-d4ff-410a-92d8-29b4184e55d0 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:44.834005 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7f5ed9ad-d4ff-410a-92d8-29b4184e55d0 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:44.840943 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7f5ed9ad-d4ff-410a-92d8-29b4184e55d0 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:44.841685 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7f5ed9ad-d4ff-410a-92d8-29b4184e55d0 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:44.842664 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7f5ed9ad-d4ff-410a-92d8-29b4184e55d0 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:44.843318 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7f5ed9ad-d4ff-410a-92d8-29b4184e55d0 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:45.193027 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b9c8ff4c-5d53-4431-b5ee-58b30e03ddea tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:45.204614 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b9c8ff4c-5d53-4431-b5ee-58b30e03ddea tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1318 microversion: 2.1 time: 0.503994 Dec 27 14:21:45.205457 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 50/111] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:44 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1318 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:21:45.210027 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d22f7ae5-5e42-4933-ac7d-d3f52db67335 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:45.210640 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d22f7ae5-5e42-4933-ac7d-d3f52db67335 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:45.217422 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d22f7ae5-5e42-4933-ac7d-d3f52db67335 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:45.217726 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d22f7ae5-5e42-4933-ac7d-d3f52db67335 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:45.218479 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d22f7ae5-5e42-4933-ac7d-d3f52db67335 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:45.219430 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d22f7ae5-5e42-4933-ac7d-d3f52db67335 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:45.260893 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7f5ed9ad-d4ff-410a-92d8-29b4184e55d0 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:45.269251 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7f5ed9ad-d4ff-410a-92d8-29b4184e55d0 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1322 microversion: 2.1 time: 0.439414 Dec 27 14:21:45.270107 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 62/112] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:44 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1322 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:45.477774 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bb45e594-cb94-4015-ac82-23a23f64784a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:45.478514 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bb45e594-cb94-4015-ac82-23a23f64784a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:45.485131 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb45e594-cb94-4015-ac82-23a23f64784a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:45.485584 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb45e594-cb94-4015-ac82-23a23f64784a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:45.486648 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb45e594-cb94-4015-ac82-23a23f64784a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:45.487180 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb45e594-cb94-4015-ac82-23a23f64784a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:45.593308 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d22f7ae5-5e42-4933-ac7d-d3f52db67335 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:45.609004 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d22f7ae5-5e42-4933-ac7d-d3f52db67335 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1315 microversion: 2.1 time: 0.399833 Dec 27 14:21:45.609004 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 51/113] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:45 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:45.719180 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-98bacda8-1d1d-4de8-98b9-27317f300955 req-641eaef4-8338-487c-9f08-a11634c2f47f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c", "tag": "8ec9ce5c-8ee9-4fb6-8eb7-caec5c408fc1"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:21:45.724259 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:21:45.724259 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:21:45.736436 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-98bacda8-1d1d-4de8-98b9-27317f300955 req-641eaef4-8338-487c-9f08-a11634c2f47f service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:45.737225 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-98bacda8-1d1d-4de8-98b9-27317f300955 req-641eaef4-8338-487c-9f08-a11634c2f47f service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:45.756850 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-98bacda8-1d1d-4de8-98b9-27317f300955 req-641eaef4-8338-487c-9f08-a11634c2f47f service nova] Creating event network-changed:8ec9ce5c-8ee9-4fb6-8eb7-caec5c408fc1 for instance 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c on hv-cinder-82301 Dec 27 14:21:45.765133 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-98bacda8-1d1d-4de8-98b9-27317f300955 req-641eaef4-8338-487c-9f08-a11634c2f47f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052333 Dec 27 14:21:45.767047 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 52/114] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:21:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:21:45.825274 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bb45e594-cb94-4015-ac82-23a23f64784a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:45.833492 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bb45e594-cb94-4015-ac82-23a23f64784a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1362 microversion: 2.1 time: 0.359262 Dec 27 14:21:45.834449 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 63/115] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:45 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1362 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:21:46.225946 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b8a21e50-dd5b-4f0c-a8b4-9b396f295aae tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:46.228271 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b8a21e50-dd5b-4f0c-a8b4-9b396f295aae tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:46.239682 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b8a21e50-dd5b-4f0c-a8b4-9b396f295aae tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:46.240461 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b8a21e50-dd5b-4f0c-a8b4-9b396f295aae tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:46.241371 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b8a21e50-dd5b-4f0c-a8b4-9b396f295aae tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:46.242401 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b8a21e50-dd5b-4f0c-a8b4-9b396f295aae tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:46.288317 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-be031e30-6ac3-4611-b069-2fe6d21f80d5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:46.288839 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-be031e30-6ac3-4611-b069-2fe6d21f80d5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:46.297548 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-be031e30-6ac3-4611-b069-2fe6d21f80d5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:46.298247 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-be031e30-6ac3-4611-b069-2fe6d21f80d5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:46.299038 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-be031e30-6ac3-4611-b069-2fe6d21f80d5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:46.299988 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-be031e30-6ac3-4611-b069-2fe6d21f80d5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:46.727823 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-be031e30-6ac3-4611-b069-2fe6d21f80d5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:46.736806 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-be031e30-6ac3-4611-b069-2fe6d21f80d5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1322 microversion: 2.1 time: 0.453346 Dec 27 14:21:46.738049 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 64/116] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:46 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1322 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:46.743382 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-06b55a89-c2bc-4cb9-ad5e-236272a935ea tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:46.744145 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-06b55a89-c2bc-4cb9-ad5e-236272a935ea tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:46.751303 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-06b55a89-c2bc-4cb9-ad5e-236272a935ea tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:46.752134 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-06b55a89-c2bc-4cb9-ad5e-236272a935ea tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:46.753178 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-06b55a89-c2bc-4cb9-ad5e-236272a935ea tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:46.753847 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-06b55a89-c2bc-4cb9-ad5e-236272a935ea tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:46.831936 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b8a21e50-dd5b-4f0c-a8b4-9b396f295aae tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:46.845532 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b8a21e50-dd5b-4f0c-a8b4-9b396f295aae tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1318 microversion: 2.1 time: 0.624366 Dec 27 14:21:46.848251 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 53/117] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:46 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1318 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:46.852882 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2afce124-9292-4084-9952-77f812cf0e31 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:46.853454 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2afce124-9292-4084-9952-77f812cf0e31 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:46.862881 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2afce124-9292-4084-9952-77f812cf0e31 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:46.863516 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2afce124-9292-4084-9952-77f812cf0e31 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:46.865069 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2afce124-9292-4084-9952-77f812cf0e31 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:46.865697 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2afce124-9292-4084-9952-77f812cf0e31 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:47.007620 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-06b55a89-c2bc-4cb9-ad5e-236272a935ea tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:47.021514 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-06b55a89-c2bc-4cb9-ad5e-236272a935ea tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1315 microversion: 2.1 time: 0.282201 Dec 27 14:21:47.022083 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 65/118] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:46 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:47.061657 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-2afce124-9292-4084-9952-77f812cf0e31 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:47.072416 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2afce124-9292-4084-9952-77f812cf0e31 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1362 microversion: 2.1 time: 0.222736 Dec 27 14:21:47.076337 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 54/119] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:46 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:47.797626 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-16fcada0-2dd1-4ded-a776-40adcb6b4642 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:47.798239 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-16fcada0-2dd1-4ded-a776-40adcb6b4642 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:47.806043 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16fcada0-2dd1-4ded-a776-40adcb6b4642 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:47.808158 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16fcada0-2dd1-4ded-a776-40adcb6b4642 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:47.809211 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16fcada0-2dd1-4ded-a776-40adcb6b4642 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:47.809856 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16fcada0-2dd1-4ded-a776-40adcb6b4642 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:47.865408 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6ddae307-480a-4c09-8732-aabe29a3b209 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:47.866705 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6ddae307-480a-4c09-8732-aabe29a3b209 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:47.875392 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6ddae307-480a-4c09-8732-aabe29a3b209 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:47.876116 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6ddae307-480a-4c09-8732-aabe29a3b209 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:47.877145 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6ddae307-480a-4c09-8732-aabe29a3b209 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:47.877813 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6ddae307-480a-4c09-8732-aabe29a3b209 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:48.054492 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6ddae307-480a-4c09-8732-aabe29a3b209 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:48.070725 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6ddae307-480a-4c09-8732-aabe29a3b209 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1318 microversion: 2.1 time: 0.209087 Dec 27 14:21:48.086078 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 55/120] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:47 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:48.091740 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4d36426e-8000-41d5-bddd-a023e04d439d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:48.092395 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4d36426e-8000-41d5-bddd-a023e04d439d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:48.093027 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-16fcada0-2dd1-4ded-a776-40adcb6b4642 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:48.098958 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4d36426e-8000-41d5-bddd-a023e04d439d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:48.099417 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4d36426e-8000-41d5-bddd-a023e04d439d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:48.100241 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4d36426e-8000-41d5-bddd-a023e04d439d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:48.100677 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4d36426e-8000-41d5-bddd-a023e04d439d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:48.100879 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-16fcada0-2dd1-4ded-a776-40adcb6b4642 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1322 microversion: 2.1 time: 0.306922 Dec 27 14:21:48.101453 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 66/121] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:47 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:48.112426 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-583ac645-fe3f-4326-ae49-8d41a0189fdc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:48.113039 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-583ac645-fe3f-4326-ae49-8d41a0189fdc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:48.122676 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-583ac645-fe3f-4326-ae49-8d41a0189fdc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:48.123073 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-583ac645-fe3f-4326-ae49-8d41a0189fdc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:48.123907 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-583ac645-fe3f-4326-ae49-8d41a0189fdc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:48.128079 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-583ac645-fe3f-4326-ae49-8d41a0189fdc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:48.280236 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4d36426e-8000-41d5-bddd-a023e04d439d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:48.288149 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4d36426e-8000-41d5-bddd-a023e04d439d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1315 microversion: 2.1 time: 0.200727 Dec 27 14:21:48.288920 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 56/122] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:48 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:48.290573 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-583ac645-fe3f-4326-ae49-8d41a0189fdc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:48.298468 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-583ac645-fe3f-4326-ae49-8d41a0189fdc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1362 microversion: 2.1 time: 0.194046 Dec 27 14:21:48.299221 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 67/123] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:48 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:49.092463 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-57531374-c20d-4fed-a8db-0616129a6b8b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:49.094085 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-57531374-c20d-4fed-a8db-0616129a6b8b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:49.103971 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-57531374-c20d-4fed-a8db-0616129a6b8b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:49.104723 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-57531374-c20d-4fed-a8db-0616129a6b8b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:49.106105 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-57531374-c20d-4fed-a8db-0616129a6b8b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:49.107393 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-57531374-c20d-4fed-a8db-0616129a6b8b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:49.122655 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-21115624-a8a8-4c8e-b775-ebea445c0fb2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:49.124458 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-21115624-a8a8-4c8e-b775-ebea445c0fb2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:49.132165 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21115624-a8a8-4c8e-b775-ebea445c0fb2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:49.133336 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21115624-a8a8-4c8e-b775-ebea445c0fb2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:49.136072 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21115624-a8a8-4c8e-b775-ebea445c0fb2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:49.136749 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21115624-a8a8-4c8e-b775-ebea445c0fb2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:49.299535 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-57531374-c20d-4fed-a8db-0616129a6b8b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:49.313568 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-57531374-c20d-4fed-a8db-0616129a6b8b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1318 microversion: 2.1 time: 0.225628 Dec 27 14:21:49.314553 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 57/124] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:49 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:49.326941 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8f067d00-d3d8-4385-bb4b-51c3f3bc349d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:49.327692 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8f067d00-d3d8-4385-bb4b-51c3f3bc349d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:49.336742 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f067d00-d3d8-4385-bb4b-51c3f3bc349d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:49.337200 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f067d00-d3d8-4385-bb4b-51c3f3bc349d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:49.339257 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f067d00-d3d8-4385-bb4b-51c3f3bc349d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:49.339789 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f067d00-d3d8-4385-bb4b-51c3f3bc349d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:49.462182 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-21115624-a8a8-4c8e-b775-ebea445c0fb2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:49.475676 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-21115624-a8a8-4c8e-b775-ebea445c0fb2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1322 microversion: 2.1 time: 0.361273 Dec 27 14:21:49.476595 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 68/125] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:49 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1322 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:21:49.483419 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e2f23c27-9144-468a-b5a1-ba45a8f1757d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:49.492737 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e2f23c27-9144-468a-b5a1-ba45a8f1757d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:49.506176 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2f23c27-9144-468a-b5a1-ba45a8f1757d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:49.506630 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2f23c27-9144-468a-b5a1-ba45a8f1757d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:49.509444 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2f23c27-9144-468a-b5a1-ba45a8f1757d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:49.509889 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2f23c27-9144-468a-b5a1-ba45a8f1757d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:49.928330 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e2f23c27-9144-468a-b5a1-ba45a8f1757d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:49.941233 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e2f23c27-9144-468a-b5a1-ba45a8f1757d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1362 microversion: 2.1 time: 0.457914 Dec 27 14:21:49.942173 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 69/126] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:49 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1362 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:50.042708 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8f067d00-d3d8-4385-bb4b-51c3f3bc349d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:50.056291 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8f067d00-d3d8-4385-bb4b-51c3f3bc349d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1315 microversion: 2.1 time: 0.740495 Dec 27 14:21:50.058058 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 58/127] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:49 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1315 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:50.330582 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9c4874dc-91c7-4954-a58a-d703d46bcfe1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:50.331193 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9c4874dc-91c7-4954-a58a-d703d46bcfe1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:50.343910 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c4874dc-91c7-4954-a58a-d703d46bcfe1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:50.344370 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c4874dc-91c7-4954-a58a-d703d46bcfe1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:50.345173 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c4874dc-91c7-4954-a58a-d703d46bcfe1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:50.345609 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9c4874dc-91c7-4954-a58a-d703d46bcfe1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:50.498352 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-33ddaf36-d115-484a-b5f2-1d8ca80a265e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:50.501103 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-33ddaf36-d115-484a-b5f2-1d8ca80a265e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:50.512770 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-33ddaf36-d115-484a-b5f2-1d8ca80a265e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:50.513558 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-33ddaf36-d115-484a-b5f2-1d8ca80a265e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:50.515175 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-33ddaf36-d115-484a-b5f2-1d8ca80a265e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:50.516882 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-33ddaf36-d115-484a-b5f2-1d8ca80a265e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:50.600118 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9c4874dc-91c7-4954-a58a-d703d46bcfe1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:50.608807 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9c4874dc-91c7-4954-a58a-d703d46bcfe1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1318 microversion: 2.1 time: 0.281955 Dec 27 14:21:50.615996 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 70/128] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:50 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:21:50.766238 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-33ddaf36-d115-484a-b5f2-1d8ca80a265e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:50.773722 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-33ddaf36-d115-484a-b5f2-1d8ca80a265e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1322 microversion: 2.1 time: 0.284659 Dec 27 14:21:50.774759 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 59/129] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:50 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:21:50.958492 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ce0a84f8-0448-46d0-b97a-6936bdf75ed0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:50.959095 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ce0a84f8-0448-46d0-b97a-6936bdf75ed0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:50.965669 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce0a84f8-0448-46d0-b97a-6936bdf75ed0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:50.966110 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce0a84f8-0448-46d0-b97a-6936bdf75ed0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:50.967067 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce0a84f8-0448-46d0-b97a-6936bdf75ed0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:50.967574 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce0a84f8-0448-46d0-b97a-6936bdf75ed0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:51.073475 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-144cc5b8-b990-46d1-a406-bf9b17bd91e5 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:51.074182 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-144cc5b8-b990-46d1-a406-bf9b17bd91e5 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:51.084801 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-144cc5b8-b990-46d1-a406-bf9b17bd91e5 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:51.086469 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-144cc5b8-b990-46d1-a406-bf9b17bd91e5 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:51.087427 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-144cc5b8-b990-46d1-a406-bf9b17bd91e5 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:51.088295 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-144cc5b8-b990-46d1-a406-bf9b17bd91e5 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:51.131082 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ce0a84f8-0448-46d0-b97a-6936bdf75ed0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:51.143587 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ce0a84f8-0448-46d0-b97a-6936bdf75ed0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1362 microversion: 2.1 time: 0.188725 Dec 27 14:21:51.144353 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 71/130] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:50 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:51.241818 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-144cc5b8-b990-46d1-a406-bf9b17bd91e5 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:51.249380 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-144cc5b8-b990-46d1-a406-bf9b17bd91e5 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1315 microversion: 2.1 time: 0.180326 Dec 27 14:21:51.249946 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 60/131] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:51 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:21:51.632147 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-845cfc76-2a86-4827-8bff-819830be7f6b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:51.632856 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-845cfc76-2a86-4827-8bff-819830be7f6b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:51.639774 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-845cfc76-2a86-4827-8bff-819830be7f6b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:51.640897 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-845cfc76-2a86-4827-8bff-819830be7f6b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:51.641786 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-845cfc76-2a86-4827-8bff-819830be7f6b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:51.642660 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-845cfc76-2a86-4827-8bff-819830be7f6b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:51.794597 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d33d1b7d-08a7-4bde-abb2-6b621cbee0df tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:51.795940 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d33d1b7d-08a7-4bde-abb2-6b621cbee0df tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:51.801456 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-845cfc76-2a86-4827-8bff-819830be7f6b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:51.806590 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d33d1b7d-08a7-4bde-abb2-6b621cbee0df tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:51.809703 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d33d1b7d-08a7-4bde-abb2-6b621cbee0df tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:51.810766 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d33d1b7d-08a7-4bde-abb2-6b621cbee0df tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:51.811264 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d33d1b7d-08a7-4bde-abb2-6b621cbee0df tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:51.814395 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-845cfc76-2a86-4827-8bff-819830be7f6b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1318 microversion: 2.1 time: 0.186051 Dec 27 14:21:51.815462 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 72/132] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:51 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:51.956043 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d33d1b7d-08a7-4bde-abb2-6b621cbee0df tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:51.966742 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d33d1b7d-08a7-4bde-abb2-6b621cbee0df tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1322 microversion: 2.1 time: 0.177664 Dec 27 14:21:51.967944 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 61/133] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:51 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:52.160988 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-47ef51c3-bad2-4b63-bb89-fc3f7112ba51 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:52.161638 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-47ef51c3-bad2-4b63-bb89-fc3f7112ba51 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:52.168960 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47ef51c3-bad2-4b63-bb89-fc3f7112ba51 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:52.169784 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47ef51c3-bad2-4b63-bb89-fc3f7112ba51 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:52.170890 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47ef51c3-bad2-4b63-bb89-fc3f7112ba51 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:52.171550 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47ef51c3-bad2-4b63-bb89-fc3f7112ba51 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:52.269307 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-bdf50533-4b93-4b80-992d-2c99027bf172 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:52.270191 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-bdf50533-4b93-4b80-992d-2c99027bf172 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:52.276980 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bdf50533-4b93-4b80-992d-2c99027bf172 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:52.279279 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bdf50533-4b93-4b80-992d-2c99027bf172 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:52.282263 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bdf50533-4b93-4b80-992d-2c99027bf172 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:52.282952 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bdf50533-4b93-4b80-992d-2c99027bf172 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:52.343689 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-47ef51c3-bad2-4b63-bb89-fc3f7112ba51 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:52.352567 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-47ef51c3-bad2-4b63-bb89-fc3f7112ba51 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1362 microversion: 2.1 time: 0.194357 Dec 27 14:21:52.353461 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 73/134] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:52 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:52.471784 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-bdf50533-4b93-4b80-992d-2c99027bf172 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:52.479630 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-bdf50533-4b93-4b80-992d-2c99027bf172 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1315 microversion: 2.1 time: 0.214143 Dec 27 14:21:52.480240 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 62/135] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:52 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:52.833206 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c7f388ff-c72d-45ed-8595-212940c7c8e7 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:52.834287 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c7f388ff-c72d-45ed-8595-212940c7c8e7 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:52.858048 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c7f388ff-c72d-45ed-8595-212940c7c8e7 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:52.859790 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c7f388ff-c72d-45ed-8595-212940c7c8e7 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:52.861676 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c7f388ff-c72d-45ed-8595-212940c7c8e7 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:52.862121 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c7f388ff-c72d-45ed-8595-212940c7c8e7 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:52.986007 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7729d786-8a4c-4a41-8dc4-d66a1a610774 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:52.986769 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7729d786-8a4c-4a41-8dc4-d66a1a610774 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:52.999064 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7729d786-8a4c-4a41-8dc4-d66a1a610774 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:52.999763 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7729d786-8a4c-4a41-8dc4-d66a1a610774 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:53.000793 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7729d786-8a4c-4a41-8dc4-d66a1a610774 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:53.003043 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7729d786-8a4c-4a41-8dc4-d66a1a610774 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:53.037532 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c7f388ff-c72d-45ed-8595-212940c7c8e7 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:53.046283 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c7f388ff-c72d-45ed-8595-212940c7c8e7 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1318 microversion: 2.1 time: 0.218219 Dec 27 14:21:53.046858 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 74/136] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:52 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:53.229884 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-7729d786-8a4c-4a41-8dc4-d66a1a610774 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:53.237714 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7729d786-8a4c-4a41-8dc4-d66a1a610774 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1322 microversion: 2.1 time: 0.256858 Dec 27 14:21:53.238402 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 63/137] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:52 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:53.370942 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4d269e89-8f9f-4391-bb89-203a2dd78330 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:53.371802 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4d269e89-8f9f-4391-bb89-203a2dd78330 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:53.377693 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4d269e89-8f9f-4391-bb89-203a2dd78330 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:53.378145 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4d269e89-8f9f-4391-bb89-203a2dd78330 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:53.379659 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4d269e89-8f9f-4391-bb89-203a2dd78330 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:53.380283 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4d269e89-8f9f-4391-bb89-203a2dd78330 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:53.496545 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9b26d66f-6c6a-4db9-bccd-144131606d28 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:53.497149 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9b26d66f-6c6a-4db9-bccd-144131606d28 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:53.503450 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b26d66f-6c6a-4db9-bccd-144131606d28 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:53.504093 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b26d66f-6c6a-4db9-bccd-144131606d28 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:53.505054 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b26d66f-6c6a-4db9-bccd-144131606d28 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:53.505637 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b26d66f-6c6a-4db9-bccd-144131606d28 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:53.554736 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4d269e89-8f9f-4391-bb89-203a2dd78330 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:53.564442 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4d269e89-8f9f-4391-bb89-203a2dd78330 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1362 microversion: 2.1 time: 0.198491 Dec 27 14:21:53.565020 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 75/138] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:53 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:53.763911 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9b26d66f-6c6a-4db9-bccd-144131606d28 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:53.774422 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9b26d66f-6c6a-4db9-bccd-144131606d28 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1315 microversion: 2.1 time: 0.282018 Dec 27 14:21:53.776512 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 64/139] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:53 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:21:54.062514 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4a383eb8-4f90-4abc-a97a-93ed40749794 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:54.063310 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4a383eb8-4f90-4abc-a97a-93ed40749794 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:54.070149 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a383eb8-4f90-4abc-a97a-93ed40749794 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:54.070725 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a383eb8-4f90-4abc-a97a-93ed40749794 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:54.074021 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a383eb8-4f90-4abc-a97a-93ed40749794 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:54.074865 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a383eb8-4f90-4abc-a97a-93ed40749794 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:54.256931 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d07a182a-25b8-4678-9027-f55fa4f68cc1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:54.258393 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d07a182a-25b8-4678-9027-f55fa4f68cc1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:54.273654 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d07a182a-25b8-4678-9027-f55fa4f68cc1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:54.276452 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d07a182a-25b8-4678-9027-f55fa4f68cc1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:54.277699 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d07a182a-25b8-4678-9027-f55fa4f68cc1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:54.278697 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d07a182a-25b8-4678-9027-f55fa4f68cc1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:54.296341 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4a383eb8-4f90-4abc-a97a-93ed40749794 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:54.306979 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4a383eb8-4f90-4abc-a97a-93ed40749794 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1318 microversion: 2.1 time: 0.248008 Dec 27 14:21:54.314547 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 76/140] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:54 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:54.499772 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d07a182a-25b8-4678-9027-f55fa4f68cc1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:54.511141 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d07a182a-25b8-4678-9027-f55fa4f68cc1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1322 microversion: 2.1 time: 0.259770 Dec 27 14:21:54.513935 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 65/141] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:54 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:54.581519 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-206b374b-0f21-483a-9835-1334c3dcc6da tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:54.582517 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-206b374b-0f21-483a-9835-1334c3dcc6da tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:54.593359 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-206b374b-0f21-483a-9835-1334c3dcc6da tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:54.593803 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-206b374b-0f21-483a-9835-1334c3dcc6da tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:54.594641 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-206b374b-0f21-483a-9835-1334c3dcc6da tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:54.595397 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-206b374b-0f21-483a-9835-1334c3dcc6da tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:54.813965 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-206b374b-0f21-483a-9835-1334c3dcc6da tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:54.829264 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-206b374b-0f21-483a-9835-1334c3dcc6da tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1362 microversion: 2.1 time: 0.247503 Dec 27 14:21:54.843228 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 77/142] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:54 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:54.852758 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5462c409-acd0-4d09-bf83-1a7d045a3862 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:54.854344 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5462c409-acd0-4d09-bf83-1a7d045a3862 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:54.861690 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5462c409-acd0-4d09-bf83-1a7d045a3862 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:54.862578 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5462c409-acd0-4d09-bf83-1a7d045a3862 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:54.863420 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5462c409-acd0-4d09-bf83-1a7d045a3862 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:54.864003 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5462c409-acd0-4d09-bf83-1a7d045a3862 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:54.944010 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-9c1d909b-c806-4087-abbc-1f6085cb7478 req-7f123991-de6a-401f-9317-933c0f13283c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9183a2b5-fbe1-45df-906b-e7311f3a3826", "name": "network-vif-plugged", "status": "completed", "tag": "5f034588-3141-4425-885f-1e0f76e6fb2a"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:21:54.945868 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:21:54.945868 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:21:54.960457 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-9c1d909b-c806-4087-abbc-1f6085cb7478 req-7f123991-de6a-401f-9317-933c0f13283c service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:54.963672 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-9c1d909b-c806-4087-abbc-1f6085cb7478 req-7f123991-de6a-401f-9317-933c0f13283c service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:54.991718 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-9c1d909b-c806-4087-abbc-1f6085cb7478 req-7f123991-de6a-401f-9317-933c0f13283c service nova] Creating event network-vif-plugged:5f034588-3141-4425-885f-1e0f76e6fb2a for instance 9183a2b5-fbe1-45df-906b-e7311f3a3826 on hv-cinder-82301 Dec 27 14:21:55.000780 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-9c1d909b-c806-4087-abbc-1f6085cb7478 req-7f123991-de6a-401f-9317-933c0f13283c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.300651 Dec 27 14:21:55.002678 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 66/143] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:21:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:21:55.184106 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5462c409-acd0-4d09-bf83-1a7d045a3862 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:55.207351 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5462c409-acd0-4d09-bf83-1a7d045a3862 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1315 microversion: 2.1 time: 0.361639 Dec 27 14:21:55.230463 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 78/144] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:54 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:55.329274 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e0b8e2e9-de8f-4502-a444-7fbef6cbb056 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:55.331236 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e0b8e2e9-de8f-4502-a444-7fbef6cbb056 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:55.344655 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e0b8e2e9-de8f-4502-a444-7fbef6cbb056 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:55.351418 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e0b8e2e9-de8f-4502-a444-7fbef6cbb056 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:55.352281 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e0b8e2e9-de8f-4502-a444-7fbef6cbb056 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:55.352720 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e0b8e2e9-de8f-4502-a444-7fbef6cbb056 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:55.530286 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bf802772-0145-4eb3-9970-84ec7f9f6c1b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:55.531049 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bf802772-0145-4eb3-9970-84ec7f9f6c1b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:55.544145 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bf802772-0145-4eb3-9970-84ec7f9f6c1b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:55.544598 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bf802772-0145-4eb3-9970-84ec7f9f6c1b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:55.545397 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bf802772-0145-4eb3-9970-84ec7f9f6c1b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:55.545820 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bf802772-0145-4eb3-9970-84ec7f9f6c1b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:55.697026 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e0b8e2e9-de8f-4502-a444-7fbef6cbb056 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:55.706323 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e0b8e2e9-de8f-4502-a444-7fbef6cbb056 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1318 microversion: 2.1 time: 0.381224 Dec 27 14:21:55.710774 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 67/145] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:55 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:55.762779 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bf802772-0145-4eb3-9970-84ec7f9f6c1b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:55.772690 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bf802772-0145-4eb3-9970-84ec7f9f6c1b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1322 microversion: 2.1 time: 0.245932 Dec 27 14:21:55.782515 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 79/146] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:55 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:21:55.848063 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-eb5e39dd-5e6f-4164-af4f-b7bcd11da874 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:55.849050 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-eb5e39dd-5e6f-4164-af4f-b7bcd11da874 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:55.860144 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb5e39dd-5e6f-4164-af4f-b7bcd11da874 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:55.860608 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb5e39dd-5e6f-4164-af4f-b7bcd11da874 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:55.861395 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb5e39dd-5e6f-4164-af4f-b7bcd11da874 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:55.862377 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb5e39dd-5e6f-4164-af4f-b7bcd11da874 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:56.067181 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-eb5e39dd-5e6f-4164-af4f-b7bcd11da874 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:56.075453 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-eb5e39dd-5e6f-4164-af4f-b7bcd11da874 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1362 microversion: 2.1 time: 0.232270 Dec 27 14:21:56.076281 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 68/147] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:55 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:56.229590 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3c807d2c-c3e3-4289-8a69-08f837e9306d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:56.230513 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3c807d2c-c3e3-4289-8a69-08f837e9306d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:56.239309 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3c807d2c-c3e3-4289-8a69-08f837e9306d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:56.240145 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3c807d2c-c3e3-4289-8a69-08f837e9306d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:56.241117 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3c807d2c-c3e3-4289-8a69-08f837e9306d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:56.241615 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3c807d2c-c3e3-4289-8a69-08f837e9306d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:56.395794 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3c807d2c-c3e3-4289-8a69-08f837e9306d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:56.404329 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3c807d2c-c3e3-4289-8a69-08f837e9306d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1315 microversion: 2.1 time: 0.181415 Dec 27 14:21:56.405365 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 80/148] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:56 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:56.730290 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9b2ad8e3-d3a3-4932-9894-88ecd81b5e50 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:56.731267 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9b2ad8e3-d3a3-4932-9894-88ecd81b5e50 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:56.741322 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b2ad8e3-d3a3-4932-9894-88ecd81b5e50 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:56.742020 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b2ad8e3-d3a3-4932-9894-88ecd81b5e50 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:56.742967 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b2ad8e3-d3a3-4932-9894-88ecd81b5e50 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:56.743564 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b2ad8e3-d3a3-4932-9894-88ecd81b5e50 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:56.790251 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-07c1d070-d09b-400c-b282-5c0fd4b286c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:56.792060 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-07c1d070-d09b-400c-b282-5c0fd4b286c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:56.802566 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-07c1d070-d09b-400c-b282-5c0fd4b286c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:56.805211 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-07c1d070-d09b-400c-b282-5c0fd4b286c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:56.807420 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-07c1d070-d09b-400c-b282-5c0fd4b286c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:56.809048 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-07c1d070-d09b-400c-b282-5c0fd4b286c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:56.955278 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9b2ad8e3-d3a3-4932-9894-88ecd81b5e50 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:56.963787 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9b2ad8e3-d3a3-4932-9894-88ecd81b5e50 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1318 microversion: 2.1 time: 0.239144 Dec 27 14:21:56.964392 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 69/149] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:56 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:57.054108 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-c14cc60f-f68f-47a9-ace9-ce98bee3492d req-9deb2110-1516-4cce-a450-82fd3afdd8dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a23bf5-4a73-4f6b-97ba-2426322d63b1", "name": "network-vif-plugged", "status": "completed", "tag": "839d0ed8-92c5-497f-a22d-8fe95743ee6c"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:21:57.056633 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:21:57.056633 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:21:57.070151 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-c14cc60f-f68f-47a9-ace9-ce98bee3492d req-9deb2110-1516-4cce-a450-82fd3afdd8dc service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:57.073090 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-c14cc60f-f68f-47a9-ace9-ce98bee3492d req-9deb2110-1516-4cce-a450-82fd3afdd8dc service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:57.086022 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-07c1d070-d09b-400c-b282-5c0fd4b286c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:57.094390 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-c14cc60f-f68f-47a9-ace9-ce98bee3492d req-9deb2110-1516-4cce-a450-82fd3afdd8dc service nova] Creating event network-vif-plugged:839d0ed8-92c5-497f-a22d-8fe95743ee6c for instance c1a23bf5-4a73-4f6b-97ba-2426322d63b1 on hv-cinder-82301 Dec 27 14:21:57.097664 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-07c1d070-d09b-400c-b282-5c0fd4b286c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1322 microversion: 2.1 time: 0.311096 Dec 27 14:21:57.098448 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 81/150] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:56 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:21:57.107751 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-c14cc60f-f68f-47a9-ace9-ce98bee3492d req-9deb2110-1516-4cce-a450-82fd3afdd8dc service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053338 Dec 27 14:21:57.107751 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 70/151] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:21:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:21:57.108125 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4e37fb84-4bab-4533-8a47-071e54cfc3c5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:57.108125 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4e37fb84-4bab-4533-8a47-071e54cfc3c5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:57.126107 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4e37fb84-4bab-4533-8a47-071e54cfc3c5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:57.126553 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4e37fb84-4bab-4533-8a47-071e54cfc3c5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:57.127382 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4e37fb84-4bab-4533-8a47-071e54cfc3c5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:57.131658 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4e37fb84-4bab-4533-8a47-071e54cfc3c5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:57.430294 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-305a362a-748e-4972-8a3c-b098d82f2b55 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:57.432674 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-305a362a-748e-4972-8a3c-b098d82f2b55 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:57.444131 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-305a362a-748e-4972-8a3c-b098d82f2b55 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:57.444862 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-305a362a-748e-4972-8a3c-b098d82f2b55 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:57.445803 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4e37fb84-4bab-4533-8a47-071e54cfc3c5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:57.446428 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-305a362a-748e-4972-8a3c-b098d82f2b55 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:57.447631 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-305a362a-748e-4972-8a3c-b098d82f2b55 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:57.457132 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4e37fb84-4bab-4533-8a47-071e54cfc3c5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1362 microversion: 2.1 time: 0.357659 Dec 27 14:21:57.457712 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 82/152] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:57 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1362 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:57.656731 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-305a362a-748e-4972-8a3c-b098d82f2b55 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:57.667379 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-305a362a-748e-4972-8a3c-b098d82f2b55 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1315 microversion: 2.1 time: 0.248864 Dec 27 14:21:57.668418 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 71/153] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:57 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:21:57.989475 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a9436fb3-fde6-459c-bbf3-f25068829604 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:57.990961 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a9436fb3-fde6-459c-bbf3-f25068829604 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:58.002882 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a9436fb3-fde6-459c-bbf3-f25068829604 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:58.003819 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a9436fb3-fde6-459c-bbf3-f25068829604 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:58.006099 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a9436fb3-fde6-459c-bbf3-f25068829604 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:58.007281 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a9436fb3-fde6-459c-bbf3-f25068829604 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:58.116957 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-30a8b950-8a6d-4d79-84fe-e30cf1083573 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:58.119137 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-30a8b950-8a6d-4d79-84fe-e30cf1083573 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:58.131970 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-30a8b950-8a6d-4d79-84fe-e30cf1083573 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:58.133800 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-30a8b950-8a6d-4d79-84fe-e30cf1083573 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:58.136296 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-30a8b950-8a6d-4d79-84fe-e30cf1083573 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:58.138704 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-30a8b950-8a6d-4d79-84fe-e30cf1083573 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:58.297091 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a9436fb3-fde6-459c-bbf3-f25068829604 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:58.309427 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a9436fb3-fde6-459c-bbf3-f25068829604 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1509 microversion: 2.1 time: 0.328317 Dec 27 14:21:58.322743 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 83/154] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:57 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1509 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:58.475255 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fc12f3c0-e683-4538-8a70-eadae8040a82 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:58.476896 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fc12f3c0-e683-4538-8a70-eadae8040a82 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:58.489309 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc12f3c0-e683-4538-8a70-eadae8040a82 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:58.490185 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc12f3c0-e683-4538-8a70-eadae8040a82 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:58.492224 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc12f3c0-e683-4538-8a70-eadae8040a82 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:58.497232 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc12f3c0-e683-4538-8a70-eadae8040a82 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:58.739358 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-30a8b950-8a6d-4d79-84fe-e30cf1083573 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:58.749272 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-30a8b950-8a6d-4d79-84fe-e30cf1083573 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1322 microversion: 2.1 time: 0.637265 Dec 27 14:21:58.761614 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 72/155] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:58 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1322 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:21:58.767586 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-95c8fdf1-d5de-458c-9622-8e620ee665dd tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:58.768338 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-95c8fdf1-d5de-458c-9622-8e620ee665dd tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:58.775153 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-95c8fdf1-d5de-458c-9622-8e620ee665dd tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:58.775603 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-95c8fdf1-d5de-458c-9622-8e620ee665dd tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:58.776874 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-95c8fdf1-d5de-458c-9622-8e620ee665dd tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:58.777516 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-95c8fdf1-d5de-458c-9622-8e620ee665dd tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:58.880489 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fc12f3c0-e683-4538-8a70-eadae8040a82 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:58.900625 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fc12f3c0-e683-4538-8a70-eadae8040a82 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1362 microversion: 2.1 time: 0.429750 Dec 27 14:21:58.912018 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 84/156] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:58 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1362 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:59.039753 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-95c8fdf1-d5de-458c-9622-8e620ee665dd tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:21:59.058564 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-95c8fdf1-d5de-458c-9622-8e620ee665dd tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1315 microversion: 2.1 time: 0.295377 Dec 27 14:21:59.068624 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 73/157] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:58 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:21:59.131976 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-27b7bea5-95cb-491b-b1f3-9ed0e2ec1fff req-cc7f21bb-4e00-4690-bf1f-4d73676eeca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f72aa5e-493b-4d61-87f7-7da3af1ab7f4", "name": "network-vif-plugged", "status": "completed", "tag": "59b42668-caea-412a-a372-6451c4f609df"}, {"server_uuid": "8520422d-f3a9-443c-9e9a-12fb03ef1bcc", "name": "network-vif-plugged", "status": "completed", "tag": "43013b38-d0e6-4557-ae2b-adff54b730ab"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:21:59.134412 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:21:59.134412 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:21:59.146396 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-27b7bea5-95cb-491b-b1f3-9ed0e2ec1fff req-cc7f21bb-4e00-4690-bf1f-4d73676eeca2 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:59.147814 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-27b7bea5-95cb-491b-b1f3-9ed0e2ec1fff req-cc7f21bb-4e00-4690-bf1f-4d73676eeca2 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:59.165281 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-27b7bea5-95cb-491b-b1f3-9ed0e2ec1fff req-cc7f21bb-4e00-4690-bf1f-4d73676eeca2 service nova] Creating event network-vif-plugged:59b42668-caea-412a-a372-6451c4f609df for instance 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 on hv-cinder-82301 Dec 27 14:21:59.166175 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-27b7bea5-95cb-491b-b1f3-9ed0e2ec1fff req-cc7f21bb-4e00-4690-bf1f-4d73676eeca2 service nova] Creating event network-vif-plugged:43013b38-d0e6-4557-ae2b-adff54b730ab for instance 8520422d-f3a9-443c-9e9a-12fb03ef1bcc on hv-cinder-82301 Dec 27 14:21:59.176002 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-27b7bea5-95cb-491b-b1f3-9ed0e2ec1fff req-cc7f21bb-4e00-4690-bf1f-4d73676eeca2 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049553 Dec 27 14:21:59.176949 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 85/158] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:21:59 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:21:59.767877 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-44ebf0d2-7251-4e85-8d65-167ac08cc442 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:59.768598 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-44ebf0d2-7251-4e85-8d65-167ac08cc442 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:59.779305 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-44ebf0d2-7251-4e85-8d65-167ac08cc442 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:59.781412 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-44ebf0d2-7251-4e85-8d65-167ac08cc442 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:59.782503 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-44ebf0d2-7251-4e85-8d65-167ac08cc442 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:59.782916 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-44ebf0d2-7251-4e85-8d65-167ac08cc442 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:59.925148 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-082cfc47-7730-4a32-be32-6a989f45b845 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:21:59.925865 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-082cfc47-7730-4a32-be32-6a989f45b845 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:21:59.947317 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-082cfc47-7730-4a32-be32-6a989f45b845 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:59.947779 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-082cfc47-7730-4a32-be32-6a989f45b845 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:21:59.948715 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-082cfc47-7730-4a32-be32-6a989f45b845 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:21:59.949032 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-082cfc47-7730-4a32-be32-6a989f45b845 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:00.106178 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-44ebf0d2-7251-4e85-8d65-167ac08cc442 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:00.115494 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-44ebf0d2-7251-4e85-8d65-167ac08cc442 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1322 microversion: 2.1 time: 0.352447 Dec 27 14:22:00.117041 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 74/159] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:59 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:00.123428 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-82fc6aed-edca-4e18-a478-55754dce4833 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "202161ff-aad4-4534-87f8-84fd052bfbff"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:00.125586 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-82fc6aed-edca-4e18-a478-55754dce4833 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:00.133298 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-82fc6aed-edca-4e18-a478-55754dce4833 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:00.133864 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-82fc6aed-edca-4e18-a478-55754dce4833 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:00.135375 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-82fc6aed-edca-4e18-a478-55754dce4833 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:00.136056 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-82fc6aed-edca-4e18-a478-55754dce4833 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:00.258214 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-082cfc47-7730-4a32-be32-6a989f45b845 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:00.266728 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-082cfc47-7730-4a32-be32-6a989f45b845 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1362 microversion: 2.1 time: 0.345462 Dec 27 14:22:00.267580 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 86/160] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:21:59 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:00.277015 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c1b4b666-75ab-4ccb-9b89-e73b5505db98 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:00.277942 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c1b4b666-75ab-4ccb-9b89-e73b5505db98 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:00.285641 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1b4b666-75ab-4ccb-9b89-e73b5505db98 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:00.286292 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1b4b666-75ab-4ccb-9b89-e73b5505db98 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:00.287268 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1b4b666-75ab-4ccb-9b89-e73b5505db98 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:00.287705 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1b4b666-75ab-4ccb-9b89-e73b5505db98 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:00.445498 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c1b4b666-75ab-4ccb-9b89-e73b5505db98 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:00.453691 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c1b4b666-75ab-4ccb-9b89-e73b5505db98 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1502 microversion: 2.1 time: 0.184859 Dec 27 14:22:00.454297 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 87/161] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:00 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1502 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:00.909561 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-82fc6aed-edca-4e18-a478-55754dce4833 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "POST /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.790519 Dec 27 14:22:00.914061 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 75/162] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Dec 27 14:22:00 2021] POST /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826/os-volume_attachments => generated 194 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:22:01.143830 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c7b2756a-bc94-4ec7-8497-b46a2f6f4f42 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:01.144905 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c7b2756a-bc94-4ec7-8497-b46a2f6f4f42 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:01.156262 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c7b2756a-bc94-4ec7-8497-b46a2f6f4f42 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:01.157471 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c7b2756a-bc94-4ec7-8497-b46a2f6f4f42 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:01.159359 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c7b2756a-bc94-4ec7-8497-b46a2f6f4f42 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:01.160172 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c7b2756a-bc94-4ec7-8497-b46a2f6f4f42 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:01.205682 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-698d7c71-ff08-44c9-92c8-0210e0bd4576 req-b50445fd-d781-47b2-897f-4c4f99d69bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c", "name": "network-vif-plugged", "status": "completed", "tag": "8ec9ce5c-8ee9-4fb6-8eb7-caec5c408fc1"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:01.219738 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:22:01.219738 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:22:01.269219 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-698d7c71-ff08-44c9-92c8-0210e0bd4576 req-b50445fd-d781-47b2-897f-4c4f99d69bdf service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:01.269950 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-698d7c71-ff08-44c9-92c8-0210e0bd4576 req-b50445fd-d781-47b2-897f-4c4f99d69bdf service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:01.334490 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-698d7c71-ff08-44c9-92c8-0210e0bd4576 req-b50445fd-d781-47b2-897f-4c4f99d69bdf service nova] Creating event network-vif-plugged:8ec9ce5c-8ee9-4fb6-8eb7-caec5c408fc1 for instance 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c on hv-cinder-82301 Dec 27 14:22:01.343274 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-698d7c71-ff08-44c9-92c8-0210e0bd4576 req-b50445fd-d781-47b2-897f-4c4f99d69bdf service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148169 Dec 27 14:22:01.351696 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 76/163] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:22:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:22:01.361075 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6e74e314-6eec-4a82-94fe-a71e215535b3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:01.362250 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6e74e314-6eec-4a82-94fe-a71e215535b3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:01.386807 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6e74e314-6eec-4a82-94fe-a71e215535b3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:01.387722 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6e74e314-6eec-4a82-94fe-a71e215535b3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:01.388862 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6e74e314-6eec-4a82-94fe-a71e215535b3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:01.389585 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6e74e314-6eec-4a82-94fe-a71e215535b3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:01.561241 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c7b2756a-bc94-4ec7-8497-b46a2f6f4f42 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:01.582365 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c7b2756a-bc94-4ec7-8497-b46a2f6f4f42 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1322 microversion: 2.1 time: 0.450768 Dec 27 14:22:01.591244 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 88/164] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:01 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1322 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:01.691829 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6e74e314-6eec-4a82-94fe-a71e215535b3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:01.706381 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6e74e314-6eec-4a82-94fe-a71e215535b3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1549 microversion: 2.1 time: 0.352459 Dec 27 14:22:01.709160 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 77/165] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:01 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1549 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:01.730017 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9bf32d85-fedf-4209-8ef1-34a4fd009088 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:01.730855 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9bf32d85-fedf-4209-8ef1-34a4fd009088 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:01.751141 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9bf32d85-fedf-4209-8ef1-34a4fd009088 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:01.751912 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9bf32d85-fedf-4209-8ef1-34a4fd009088 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:01.753227 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9bf32d85-fedf-4209-8ef1-34a4fd009088 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:01.753798 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9bf32d85-fedf-4209-8ef1-34a4fd009088 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:02.059090 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9bf32d85-fedf-4209-8ef1-34a4fd009088 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.337145 Dec 27 14:22:02.065563 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 89/166] 10.222.0.37 () {58 vars in 1274 bytes} [Mon Dec 27 14:22:01 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/os-interface => generated 285 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:22:02.349583 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d914e2a4-dbc4-45e3-b0b6-1924853356bd tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d1c07dd-c527-4ed3-a8f6-2a17718623bf"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:02.354301 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d914e2a4-dbc4-45e3-b0b6-1924853356bd tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:02.368633 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d914e2a4-dbc4-45e3-b0b6-1924853356bd tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:02.369338 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d914e2a4-dbc4-45e3-b0b6-1924853356bd tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:02.370357 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d914e2a4-dbc4-45e3-b0b6-1924853356bd tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:02.371494 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d914e2a4-dbc4-45e3-b0b6-1924853356bd tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:02.608123 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9fba3f1f-919c-430c-8a5b-cd28811730a4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:02.610285 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9fba3f1f-919c-430c-8a5b-cd28811730a4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:02.628033 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9fba3f1f-919c-430c-8a5b-cd28811730a4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:02.628609 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9fba3f1f-919c-430c-8a5b-cd28811730a4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:02.629824 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9fba3f1f-919c-430c-8a5b-cd28811730a4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:02.630466 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9fba3f1f-919c-430c-8a5b-cd28811730a4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:02.801145 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d914e2a4-dbc4-45e3-b0b6-1924853356bd tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "POST /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.469485 Dec 27 14:22:02.801685 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 78/167] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Dec 27 14:22:02 2021] POST /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1/os-volume_attachments => generated 194 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:22:02.945365 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9fba3f1f-919c-430c-8a5b-cd28811730a4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:02.984231 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9fba3f1f-919c-430c-8a5b-cd28811730a4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1322 microversion: 2.1 time: 0.381074 Dec 27 14:22:02.985041 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 90/168] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:02 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:04.003158 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d3fa1db7-b5a1-41e6-a398-1f58d16f8e03 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:04.003946 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d3fa1db7-b5a1-41e6-a398-1f58d16f8e03 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:04.015028 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d3fa1db7-b5a1-41e6-a398-1f58d16f8e03 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:04.015482 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d3fa1db7-b5a1-41e6-a398-1f58d16f8e03 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:04.020425 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d3fa1db7-b5a1-41e6-a398-1f58d16f8e03 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:04.020871 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d3fa1db7-b5a1-41e6-a398-1f58d16f8e03 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:04.266521 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-83a25a1d-663d-4bc5-ba71-52e927c59d15 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:04.267491 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-83a25a1d-663d-4bc5-ba71-52e927c59d15 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:04.274978 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83a25a1d-663d-4bc5-ba71-52e927c59d15 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:04.282687 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83a25a1d-663d-4bc5-ba71-52e927c59d15 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:04.283763 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83a25a1d-663d-4bc5-ba71-52e927c59d15 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:04.284394 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83a25a1d-663d-4bc5-ba71-52e927c59d15 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:04.340162 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d3fa1db7-b5a1-41e6-a398-1f58d16f8e03 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:04.357384 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d3fa1db7-b5a1-41e6-a398-1f58d16f8e03 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1516 microversion: 2.1 time: 0.353574 Dec 27 14:22:04.362154 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 79/169] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:03 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1516 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:04.383119 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-d2e09d35-0251-42f6-af83-95959bab0871 req-c73c0800-0c94-4a50-8506-a90dccd6cadc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f72aa5e-493b-4d61-87f7-7da3af1ab7f4", "tag": "59b42668-caea-412a-a372-6451c4f609df"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:04.386469 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:22:04.386469 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:22:04.401128 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-83a25a1d-663d-4bc5-ba71-52e927c59d15 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 14 microversion: 2.1 time: 0.137794 Dec 27 14:22:04.402043 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 91/170] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:22:04 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 27 14:22:04.408881 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8f32e14f-ff4b-4354-9bfa-21d8c10a1b3f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:04.411351 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8f32e14f-ff4b-4354-9bfa-21d8c10a1b3f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:04.415192 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-d2e09d35-0251-42f6-af83-95959bab0871 req-c73c0800-0c94-4a50-8506-a90dccd6cadc service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:04.415701 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-d2e09d35-0251-42f6-af83-95959bab0871 req-c73c0800-0c94-4a50-8506-a90dccd6cadc service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:04.426694 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8f32e14f-ff4b-4354-9bfa-21d8c10a1b3f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:04.429462 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8f32e14f-ff4b-4354-9bfa-21d8c10a1b3f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:04.431936 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8f32e14f-ff4b-4354-9bfa-21d8c10a1b3f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:04.432776 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8f32e14f-ff4b-4354-9bfa-21d8c10a1b3f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:04.440977 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-d2e09d35-0251-42f6-af83-95959bab0871 req-c73c0800-0c94-4a50-8506-a90dccd6cadc service nova] Creating event network-changed:59b42668-caea-412a-a372-6451c4f609df for instance 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 on hv-cinder-82301 Dec 27 14:22:04.455405 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-d2e09d35-0251-42f6-af83-95959bab0871 req-c73c0800-0c94-4a50-8506-a90dccd6cadc service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091505 Dec 27 14:22:04.456042 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 80/171] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:22:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:22:04.537192 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-8f32e14f-ff4b-4354-9bfa-21d8c10a1b3f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lazy-loading 'flavor' on Instance uuid 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:22:04.701664 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8f32e14f-ff4b-4354-9bfa-21d8c10a1b3f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "POST /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c/action" status: 200 len: 32 microversion: 2.1 time: 0.297411 Dec 27 14:22:04.703375 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 92/172] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:22:04 2021] POST /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c/action => generated 32 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 27 14:22:04.713477 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-40ee7ee5-cf61-4a92-b734-fe40a1aac39a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:04.714338 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-40ee7ee5-cf61-4a92-b734-fe40a1aac39a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:04.739139 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-40ee7ee5-cf61-4a92-b734-fe40a1aac39a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:04.741753 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-40ee7ee5-cf61-4a92-b734-fe40a1aac39a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:04.744410 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-40ee7ee5-cf61-4a92-b734-fe40a1aac39a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:04.744933 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-40ee7ee5-cf61-4a92-b734-fe40a1aac39a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:05.229690 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-40ee7ee5-cf61-4a92-b734-fe40a1aac39a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:05.238175 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-40ee7ee5-cf61-4a92-b734-fe40a1aac39a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.529440 Dec 27 14:22:05.250618 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 81/173] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:04 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:05.413101 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8a6ce890-4c32-407a-b784-4d6fcdd727a1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:05.415975 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8a6ce890-4c32-407a-b784-4d6fcdd727a1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:05.432085 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a6ce890-4c32-407a-b784-4d6fcdd727a1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:05.433253 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a6ce890-4c32-407a-b784-4d6fcdd727a1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:05.437939 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a6ce890-4c32-407a-b784-4d6fcdd727a1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:05.438987 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a6ce890-4c32-407a-b784-4d6fcdd727a1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:05.577183 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8a6ce890-4c32-407a-b784-4d6fcdd727a1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 14 microversion: 2.1 time: 0.166579 Dec 27 14:22:05.581666 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 93/174] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:22:05 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 27 14:22:06.258431 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d77fe7b8-6abb-44e7-93d9-daafa8c20816 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:06.259252 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d77fe7b8-6abb-44e7-93d9-daafa8c20816 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:06.265847 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d77fe7b8-6abb-44e7-93d9-daafa8c20816 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:06.266666 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d77fe7b8-6abb-44e7-93d9-daafa8c20816 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:06.268129 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d77fe7b8-6abb-44e7-93d9-daafa8c20816 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:06.268783 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d77fe7b8-6abb-44e7-93d9-daafa8c20816 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:06.422223 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d77fe7b8-6abb-44e7-93d9-daafa8c20816 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:06.431501 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d77fe7b8-6abb-44e7-93d9-daafa8c20816 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.176896 Dec 27 14:22:06.432394 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 82/175] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:06 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:06.591392 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-854d1f61-b44d-44ba-bd82-446364204c9c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:06.593133 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-854d1f61-b44d-44ba-bd82-446364204c9c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:06.600561 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-854d1f61-b44d-44ba-bd82-446364204c9c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:06.601075 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-854d1f61-b44d-44ba-bd82-446364204c9c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:06.602291 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-854d1f61-b44d-44ba-bd82-446364204c9c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:06.602893 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-854d1f61-b44d-44ba-bd82-446364204c9c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:06.682351 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-854d1f61-b44d-44ba-bd82-446364204c9c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 14 microversion: 2.1 time: 0.096521 Dec 27 14:22:06.684390 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 94/176] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:22:06 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 27 14:22:07.449821 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d9b3c07a-46db-4884-bf9e-9910551637e4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:07.450710 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d9b3c07a-46db-4884-bf9e-9910551637e4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:07.457143 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d9b3c07a-46db-4884-bf9e-9910551637e4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:07.457593 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d9b3c07a-46db-4884-bf9e-9910551637e4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:07.458446 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d9b3c07a-46db-4884-bf9e-9910551637e4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:07.458790 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d9b3c07a-46db-4884-bf9e-9910551637e4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:07.605851 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d9b3c07a-46db-4884-bf9e-9910551637e4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:07.613865 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d9b3c07a-46db-4884-bf9e-9910551637e4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.167949 Dec 27 14:22:07.614524 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 83/177] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:07 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:07.695283 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-488a87a2-a0d2-4307-8c61-2fa6aed57aad tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:07.696994 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-488a87a2-a0d2-4307-8c61-2fa6aed57aad tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:07.704669 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-488a87a2-a0d2-4307-8c61-2fa6aed57aad tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:07.705572 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-488a87a2-a0d2-4307-8c61-2fa6aed57aad tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:07.706824 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-488a87a2-a0d2-4307-8c61-2fa6aed57aad tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:07.707425 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-488a87a2-a0d2-4307-8c61-2fa6aed57aad tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:07.780281 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-488a87a2-a0d2-4307-8c61-2fa6aed57aad tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 14 microversion: 2.1 time: 0.089040 Dec 27 14:22:07.781300 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 95/178] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:22:07 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 27 14:22:08.631199 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-30df7e1f-ded8-48f6-99e8-38308cab180f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:08.632561 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-30df7e1f-ded8-48f6-99e8-38308cab180f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:08.639637 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-30df7e1f-ded8-48f6-99e8-38308cab180f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:08.640142 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-30df7e1f-ded8-48f6-99e8-38308cab180f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:08.640932 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-30df7e1f-ded8-48f6-99e8-38308cab180f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:08.641502 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-30df7e1f-ded8-48f6-99e8-38308cab180f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:08.795888 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6d2e27ac-f398-4778-8669-050401cd1733 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:08.797812 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6d2e27ac-f398-4778-8669-050401cd1733 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:08.810136 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d2e27ac-f398-4778-8669-050401cd1733 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:08.812235 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d2e27ac-f398-4778-8669-050401cd1733 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:08.814440 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d2e27ac-f398-4778-8669-050401cd1733 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:08.815195 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d2e27ac-f398-4778-8669-050401cd1733 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:08.883086 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-30df7e1f-ded8-48f6-99e8-38308cab180f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:08.890756 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-30df7e1f-ded8-48f6-99e8-38308cab180f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.263144 Dec 27 14:22:08.891323 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 84/179] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:08 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:08.937668 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6d2e27ac-f398-4778-8669-050401cd1733 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 14 microversion: 2.1 time: 0.149522 Dec 27 14:22:08.941020 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 96/180] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:22:08 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 27 14:22:09.907533 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6c137ad0-1cbd-4937-89e1-5630696f7462 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:09.908171 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6c137ad0-1cbd-4937-89e1-5630696f7462 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:09.914684 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c137ad0-1cbd-4937-89e1-5630696f7462 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:09.915161 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c137ad0-1cbd-4937-89e1-5630696f7462 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:09.916595 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c137ad0-1cbd-4937-89e1-5630696f7462 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:09.917139 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c137ad0-1cbd-4937-89e1-5630696f7462 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:09.951012 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8bf9c738-11e8-4bd3-9ef2-e319a85dab94 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:09.952369 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8bf9c738-11e8-4bd3-9ef2-e319a85dab94 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:09.965674 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8bf9c738-11e8-4bd3-9ef2-e319a85dab94 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:09.966122 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8bf9c738-11e8-4bd3-9ef2-e319a85dab94 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:09.966944 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8bf9c738-11e8-4bd3-9ef2-e319a85dab94 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:09.967559 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8bf9c738-11e8-4bd3-9ef2-e319a85dab94 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:10.050827 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6c137ad0-1cbd-4937-89e1-5630696f7462 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:10.059038 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6c137ad0-1cbd-4937-89e1-5630696f7462 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.155414 Dec 27 14:22:10.059613 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 85/181] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:09 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:11.075251 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-04302b9e-1b65-44ef-b3b9-e47623b974f1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:11.075917 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-04302b9e-1b65-44ef-b3b9-e47623b974f1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:11.082182 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-04302b9e-1b65-44ef-b3b9-e47623b974f1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:11.082636 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-04302b9e-1b65-44ef-b3b9-e47623b974f1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:11.083449 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-04302b9e-1b65-44ef-b3b9-e47623b974f1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:11.083901 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-04302b9e-1b65-44ef-b3b9-e47623b974f1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:11.231820 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-04302b9e-1b65-44ef-b3b9-e47623b974f1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:11.240155 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-04302b9e-1b65-44ef-b3b9-e47623b974f1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.168565 Dec 27 14:22:11.240724 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 86/182] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:11 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:12.257785 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-707c8c9e-6978-4133-bf05-971b76825abe tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:12.258438 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-707c8c9e-6978-4133-bf05-971b76825abe tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:12.265937 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-707c8c9e-6978-4133-bf05-971b76825abe tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:12.266640 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-707c8c9e-6978-4133-bf05-971b76825abe tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:12.267517 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-707c8c9e-6978-4133-bf05-971b76825abe tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:12.268073 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-707c8c9e-6978-4133-bf05-971b76825abe tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:12.411372 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-707c8c9e-6978-4133-bf05-971b76825abe tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:12.419266 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-707c8c9e-6978-4133-bf05-971b76825abe tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.165157 Dec 27 14:22:12.419866 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 87/183] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:12 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:13.211188 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8bf9c738-11e8-4bd3-9ef2-e319a85dab94 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 14 microversion: 2.1 time: 3.265904 Dec 27 14:22:13.213079 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 97/184] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:22:09 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 14 bytes in 3269 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 27 14:22:13.436161 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-45ecdd75-462e-423e-b7ec-f7ae3839696a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:13.437387 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-45ecdd75-462e-423e-b7ec-f7ae3839696a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:13.444818 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-45ecdd75-462e-423e-b7ec-f7ae3839696a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:13.445589 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-45ecdd75-462e-423e-b7ec-f7ae3839696a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:13.447155 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-45ecdd75-462e-423e-b7ec-f7ae3839696a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:13.447796 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-45ecdd75-462e-423e-b7ec-f7ae3839696a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:13.777762 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-45ecdd75-462e-423e-b7ec-f7ae3839696a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:13.787423 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-45ecdd75-462e-423e-b7ec-f7ae3839696a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.353867 Dec 27 14:22:13.797610 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 88/185] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:13 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:14.224331 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f8776350-4aab-4764-a4cf-bfb7bbe68881 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:14.225961 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f8776350-4aab-4764-a4cf-bfb7bbe68881 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:14.233672 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f8776350-4aab-4764-a4cf-bfb7bbe68881 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:14.234114 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f8776350-4aab-4764-a4cf-bfb7bbe68881 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:14.234895 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f8776350-4aab-4764-a4cf-bfb7bbe68881 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:14.235322 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f8776350-4aab-4764-a4cf-bfb7bbe68881 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:14.315463 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f8776350-4aab-4764-a4cf-bfb7bbe68881 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 14 microversion: 2.1 time: 0.094692 Dec 27 14:22:14.316263 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 98/186] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:22:14 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 27 14:22:14.804352 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e2401d10-7c45-4b5e-b834-e73e283122b3 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:14.805067 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e2401d10-7c45-4b5e-b834-e73e283122b3 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:14.816241 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e2401d10-7c45-4b5e-b834-e73e283122b3 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:14.816946 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e2401d10-7c45-4b5e-b834-e73e283122b3 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:14.817757 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e2401d10-7c45-4b5e-b834-e73e283122b3 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:14.818201 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e2401d10-7c45-4b5e-b834-e73e283122b3 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:15.121192 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e2401d10-7c45-4b5e-b834-e73e283122b3 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:15.153279 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e2401d10-7c45-4b5e-b834-e73e283122b3 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.352353 Dec 27 14:22:15.164116 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 89/187] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:14 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:15.330404 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e439b415-4916-4310-a65b-0303f8d40258 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:15.332438 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e439b415-4916-4310-a65b-0303f8d40258 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:15.346478 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e439b415-4916-4310-a65b-0303f8d40258 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:15.346931 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e439b415-4916-4310-a65b-0303f8d40258 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:15.347728 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e439b415-4916-4310-a65b-0303f8d40258 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:15.348213 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e439b415-4916-4310-a65b-0303f8d40258 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:15.580831 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-51848629-7d1b-4971-ad46-d30ba60c1c44 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1551858699", "imageRef": "c8bd383f-96c5-4e2b-aaa5-fabd68b307f6", "flavorRef": "452", "networks": [{"uuid": "f572a130-3f83-4c3c-b51f-af2b9bc79a2e"}]}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:15.669266 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.network.neutron [None req-51848629-7d1b-4971-ad46-d30ba60c1c44 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] validate_networks() for [('f572a130-3f83-4c3c-b51f-af2b9bc79a2e', None, None, None, None, None)] {{(pid=116105) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 27 14:22:16.342216 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-51848629-7d1b-4971-ad46-d30ba60c1c44 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Flavor limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 27 14:22:16.342833 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-51848629-7d1b-4971-ad46-d30ba60c1c44 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Image limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 27 14:22:16.343085 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-51848629-7d1b-4971-ad46-d30ba60c1c44 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Flavor pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 27 14:22:16.343474 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-51848629-7d1b-4971-ad46-d30ba60c1c44 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Image pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 27 14:22:16.343931 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-51848629-7d1b-4971-ad46-d30ba60c1c44 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 27 14:22:16.354113 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-51848629-7d1b-4971-ad46-d30ba60c1c44 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:16.355011 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-51848629-7d1b-4971-ad46-d30ba60c1c44 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:16.355945 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-51848629-7d1b-4971-ad46-d30ba60c1c44 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:16.356602 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-51848629-7d1b-4971-ad46-d30ba60c1c44 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:16.382438 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-51848629-7d1b-4971-ad46-d30ba60c1c44 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Getting quotas for project 648321538a5a439baf7e39cee8742fc4. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:22:16.387895 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-51848629-7d1b-4971-ad46-d30ba60c1c44 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Getting quotas for user 2e4c89b986aa4f2690ee1587172c17cb and project 648321538a5a439baf7e39cee8742fc4. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:22:16.402825 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-51848629-7d1b-4971-ad46-d30ba60c1c44 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Going to run 1 instances... {{(pid=116105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 27 14:22:16.405158 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-51848629-7d1b-4971-ad46-d30ba60c1c44 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c8bd383f-96c5-4e2b-aaa5-fabd68b307f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 27 14:22:16.462328 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-51848629-7d1b-4971-ad46-d30ba60c1c44 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.888951 Dec 27 14:22:16.463220 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 90/188] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Dec 27 14:22:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 27 14:22:16.475908 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-173b1b84-1359-409e-bba3-bc6924edd752 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:16.476473 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-173b1b84-1359-409e-bba3-bc6924edd752 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:16.483624 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-173b1b84-1359-409e-bba3-bc6924edd752 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:16.484467 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-173b1b84-1359-409e-bba3-bc6924edd752 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:16.485425 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-173b1b84-1359-409e-bba3-bc6924edd752 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:16.486516 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-173b1b84-1359-409e-bba3-bc6924edd752 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:16.661096 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-173b1b84-1359-409e-bba3-bc6924edd752 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:16.670336 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-173b1b84-1359-409e-bba3-bc6924edd752 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.200852 Dec 27 14:22:16.671957 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 91/189] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:16 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:16.685310 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b1f07c13-6729-47ee-b92b-79c8e1ee141b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:16.689698 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b1f07c13-6729-47ee-b92b-79c8e1ee141b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:16.757386 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b1f07c13-6729-47ee-b92b-79c8e1ee141b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:16.765836 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b1f07c13-6729-47ee-b92b-79c8e1ee141b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1218 microversion: 2.1 time: 0.091014 Dec 27 14:22:16.775644 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 92/190] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:16 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:17.686791 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e4906bef-c7a7-463f-b35d-ec9c20f9bf4c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:17.688271 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e4906bef-c7a7-463f-b35d-ec9c20f9bf4c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:17.697151 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e4906bef-c7a7-463f-b35d-ec9c20f9bf4c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:17.698495 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e4906bef-c7a7-463f-b35d-ec9c20f9bf4c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:17.699612 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e4906bef-c7a7-463f-b35d-ec9c20f9bf4c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:17.700572 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e4906bef-c7a7-463f-b35d-ec9c20f9bf4c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:17.908394 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e4906bef-c7a7-463f-b35d-ec9c20f9bf4c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:17.915699 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e4906bef-c7a7-463f-b35d-ec9c20f9bf4c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.232453 Dec 27 14:22:17.920485 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 93/191] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:17 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:17.927704 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-20da1dc2-4511-4079-a249-4de0ccde49af tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:17.928726 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-20da1dc2-4511-4079-a249-4de0ccde49af tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:17.937308 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20da1dc2-4511-4079-a249-4de0ccde49af tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:17.938669 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20da1dc2-4511-4079-a249-4de0ccde49af tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:17.940169 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20da1dc2-4511-4079-a249-4de0ccde49af tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:17.941537 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20da1dc2-4511-4079-a249-4de0ccde49af tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:18.025597 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-20da1dc2-4511-4079-a249-4de0ccde49af tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:18.034746 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-20da1dc2-4511-4079-a249-4de0ccde49af tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1222 microversion: 2.1 time: 0.112188 Dec 27 14:22:18.036222 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 94/192] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:17 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1222 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:18.937658 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c66805da-aefb-4ced-9d66-0538b17afb2a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:18.940059 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c66805da-aefb-4ced-9d66-0538b17afb2a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:18.954115 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c66805da-aefb-4ced-9d66-0538b17afb2a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:18.955609 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c66805da-aefb-4ced-9d66-0538b17afb2a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:18.956621 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c66805da-aefb-4ced-9d66-0538b17afb2a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:18.957215 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c66805da-aefb-4ced-9d66-0538b17afb2a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:19.176508 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c66805da-aefb-4ced-9d66-0538b17afb2a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:19.185363 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c66805da-aefb-4ced-9d66-0538b17afb2a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.251628 Dec 27 14:22:19.185942 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 95/193] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:18 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:19.192212 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fadeba07-bc16-4e7b-81e0-0290cfd4fc98 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:19.193169 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fadeba07-bc16-4e7b-81e0-0290cfd4fc98 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:19.200663 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fadeba07-bc16-4e7b-81e0-0290cfd4fc98 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:19.201316 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fadeba07-bc16-4e7b-81e0-0290cfd4fc98 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:19.202434 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fadeba07-bc16-4e7b-81e0-0290cfd4fc98 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:19.202878 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fadeba07-bc16-4e7b-81e0-0290cfd4fc98 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:19.284899 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-fadeba07-bc16-4e7b-81e0-0290cfd4fc98 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:19.302281 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fadeba07-bc16-4e7b-81e0-0290cfd4fc98 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1222 microversion: 2.1 time: 0.113272 Dec 27 14:22:19.304144 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 96/194] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:19 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1222 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:20.202350 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d4428bdf-3c19-4aaa-90f3-de6c84bb4933 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:20.203701 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d4428bdf-3c19-4aaa-90f3-de6c84bb4933 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:20.216563 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d4428bdf-3c19-4aaa-90f3-de6c84bb4933 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:20.217331 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d4428bdf-3c19-4aaa-90f3-de6c84bb4933 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:20.218390 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d4428bdf-3c19-4aaa-90f3-de6c84bb4933 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:20.220314 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d4428bdf-3c19-4aaa-90f3-de6c84bb4933 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:20.503697 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e439b415-4916-4310-a65b-0303f8d40258 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 15410 microversion: 2.1 time: 5.177761 Dec 27 14:22:20.505644 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 99/195] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:22:15 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 15410 bytes in 5183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:22:20.513000 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-219bd5fb-0909-4ca9-9fd5-446941c0f147 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:20.521254 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-219bd5fb-0909-4ca9-9fd5-446941c0f147 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:20.535149 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-219bd5fb-0909-4ca9-9fd5-446941c0f147 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:20.535596 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-219bd5fb-0909-4ca9-9fd5-446941c0f147 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:20.566509 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-219bd5fb-0909-4ca9-9fd5-446941c0f147 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:20.568445 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-219bd5fb-0909-4ca9-9fd5-446941c0f147 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:20.589397 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d4428bdf-3c19-4aaa-90f3-de6c84bb4933 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:20.599517 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d4428bdf-3c19-4aaa-90f3-de6c84bb4933 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.401379 Dec 27 14:22:20.603792 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 97/196] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:20 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:20.751329 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-219bd5fb-0909-4ca9-9fd5-446941c0f147 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:20.763938 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-219bd5fb-0909-4ca9-9fd5-446941c0f147 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1222 microversion: 2.1 time: 0.252702 Dec 27 14:22:20.764677 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 100/197] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:20 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1222 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:21.517347 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1c157a9b-275d-4b6f-9287-523c541d90b7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:21.519099 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1c157a9b-275d-4b6f-9287-523c541d90b7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:21.535332 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1c157a9b-275d-4b6f-9287-523c541d90b7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:21.536973 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1c157a9b-275d-4b6f-9287-523c541d90b7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:21.538063 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1c157a9b-275d-4b6f-9287-523c541d90b7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:21.541582 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1c157a9b-275d-4b6f-9287-523c541d90b7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:21.618448 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0e41f331-0a02-4799-9306-0ae261767cb8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:21.619729 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0e41f331-0a02-4799-9306-0ae261767cb8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:21.629282 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e41f331-0a02-4799-9306-0ae261767cb8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:21.636164 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e41f331-0a02-4799-9306-0ae261767cb8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:21.637878 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e41f331-0a02-4799-9306-0ae261767cb8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:21.638532 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e41f331-0a02-4799-9306-0ae261767cb8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:21.700268 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1c157a9b-275d-4b6f-9287-523c541d90b7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 17602 microversion: 2.1 time: 0.186890 Dec 27 14:22:21.701114 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 98/198] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:22:21 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 17602 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:22:21.792268 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0244033d-d14d-498d-810c-e6e7b96c8d18 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:21.793088 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0244033d-d14d-498d-810c-e6e7b96c8d18 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:21.813374 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0244033d-d14d-498d-810c-e6e7b96c8d18 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:21.816022 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0244033d-d14d-498d-810c-e6e7b96c8d18 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:21.816840 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0244033d-d14d-498d-810c-e6e7b96c8d18 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:21.817281 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0244033d-d14d-498d-810c-e6e7b96c8d18 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:22.003136 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0e41f331-0a02-4799-9306-0ae261767cb8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:22.016563 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0e41f331-0a02-4799-9306-0ae261767cb8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.402825 Dec 27 14:22:22.022630 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 101/199] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:21 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:22.046703 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0244033d-d14d-498d-810c-e6e7b96c8d18 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:22.055801 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0244033d-d14d-498d-810c-e6e7b96c8d18 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1270 microversion: 2.1 time: 0.277272 Dec 27 14:22:22.056793 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 99/200] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:21 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1270 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:22.717804 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6c452d94-094f-4213-b36e-fba23e1271a5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:22.719698 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6c452d94-094f-4213-b36e-fba23e1271a5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:22.730839 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c452d94-094f-4213-b36e-fba23e1271a5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:22.731579 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c452d94-094f-4213-b36e-fba23e1271a5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:22.732610 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c452d94-094f-4213-b36e-fba23e1271a5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:22.733381 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c452d94-094f-4213-b36e-fba23e1271a5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:22.741075 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3a032b4f-8af2-4411-a8f6-275f2f21875d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:22.741653 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3a032b4f-8af2-4411-a8f6-275f2f21875d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:22.752098 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a032b4f-8af2-4411-a8f6-275f2f21875d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:22.753954 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a032b4f-8af2-4411-a8f6-275f2f21875d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:22.755765 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a032b4f-8af2-4411-a8f6-275f2f21875d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:22.757528 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a032b4f-8af2-4411-a8f6-275f2f21875d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:22.802622 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3a032b4f-8af2-4411-a8f6-275f2f21875d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Going to try to terminate instance {{(pid=116105) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 27 14:22:22.850424 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6c452d94-094f-4213-b36e-fba23e1271a5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 17602 microversion: 2.1 time: 0.138991 Dec 27 14:22:22.854792 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 102/201] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:22:22 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 17602 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:22:22.933851 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3a032b4f-8af2-4411-a8f6-275f2f21875d tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "DELETE /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 204 len: 0 microversion: 2.1 time: 0.195684 Dec 27 14:22:22.934551 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 100/202] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Dec 27 14:22:22 2021] DELETE /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 27 14:22:22.943263 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b4468ddf-789e-4546-83b3-73dafb78bbd8 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:22.947020 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b4468ddf-789e-4546-83b3-73dafb78bbd8 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:22.954822 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4468ddf-789e-4546-83b3-73dafb78bbd8 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:22.955294 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4468ddf-789e-4546-83b3-73dafb78bbd8 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:22.956117 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4468ddf-789e-4546-83b3-73dafb78bbd8 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:22.956553 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4468ddf-789e-4546-83b3-73dafb78bbd8 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:23.036975 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f74af549-7292-4527-a91a-61c8337d600f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:23.037685 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f74af549-7292-4527-a91a-61c8337d600f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:23.046780 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f74af549-7292-4527-a91a-61c8337d600f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:23.047477 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f74af549-7292-4527-a91a-61c8337d600f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:23.048474 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f74af549-7292-4527-a91a-61c8337d600f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:23.052161 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f74af549-7292-4527-a91a-61c8337d600f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:23.192641 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b4468ddf-789e-4546-83b3-73dafb78bbd8 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:23.212092 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b4468ddf-789e-4546-83b3-73dafb78bbd8 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1554 microversion: 2.1 time: 0.272134 Dec 27 14:22:23.213360 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 103/203] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:22 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1554 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:23.218092 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6f539855-5bca-4396-ad26-4b9edfc95bc1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:23.219142 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6f539855-5bca-4396-ad26-4b9edfc95bc1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:23.230117 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f539855-5bca-4396-ad26-4b9edfc95bc1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:23.230117 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f539855-5bca-4396-ad26-4b9edfc95bc1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:23.230117 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f539855-5bca-4396-ad26-4b9edfc95bc1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:23.230635 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f539855-5bca-4396-ad26-4b9edfc95bc1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:23.366051 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6f539855-5bca-4396-ad26-4b9edfc95bc1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:23.379033 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6f539855-5bca-4396-ad26-4b9edfc95bc1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1276 microversion: 2.1 time: 0.164356 Dec 27 14:22:23.393488 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 104/204] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:23 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1276 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:23.504322 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f74af549-7292-4527-a91a-61c8337d600f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:23.514931 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f74af549-7292-4527-a91a-61c8337d600f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.484197 Dec 27 14:22:23.518939 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 101/205] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:23 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:23.863616 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-97f4f732-05ac-4da1-812c-2096134118e3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:23.865318 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-97f4f732-05ac-4da1-812c-2096134118e3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:23.878800 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-97f4f732-05ac-4da1-812c-2096134118e3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:23.879869 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-97f4f732-05ac-4da1-812c-2096134118e3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:23.887263 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-97f4f732-05ac-4da1-812c-2096134118e3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:23.887745 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-97f4f732-05ac-4da1-812c-2096134118e3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:23.982650 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-97f4f732-05ac-4da1-812c-2096134118e3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 19133 microversion: 2.1 time: 0.122874 Dec 27 14:22:23.983490 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 105/206] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:22:23 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 19133 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:22:24.234894 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-16ff1662-66eb-4a34-86a4-cb58ef333de7 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:24.235579 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-16ff1662-66eb-4a34-86a4-cb58ef333de7 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:24.247286 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-16ff1662-66eb-4a34-86a4-cb58ef333de7 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:24.248151 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-16ff1662-66eb-4a34-86a4-cb58ef333de7 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:24.254039 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-16ff1662-66eb-4a34-86a4-cb58ef333de7 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:24.255354 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-16ff1662-66eb-4a34-86a4-cb58ef333de7 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:24.404642 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-862f0967-692d-47e1-826c-969b0ad64590 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:24.405388 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-862f0967-692d-47e1-826c-969b0ad64590 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:24.421694 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-862f0967-692d-47e1-826c-969b0ad64590 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:24.423987 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-862f0967-692d-47e1-826c-969b0ad64590 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:24.427096 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-862f0967-692d-47e1-826c-969b0ad64590 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:24.427566 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-862f0967-692d-47e1-826c-969b0ad64590 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:24.707959 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-16ff1662-66eb-4a34-86a4-cb58ef333de7 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:24.716461 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-16ff1662-66eb-4a34-86a4-cb58ef333de7 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1554 microversion: 2.1 time: 0.489061 Dec 27 14:22:24.717509 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 102/207] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:24 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1554 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:24.730509 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e8cd4797-c127-4d87-b45b-034b49e1e3f2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:24.735124 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-862f0967-692d-47e1-826c-969b0ad64590 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:24.738309 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e8cd4797-c127-4d87-b45b-034b49e1e3f2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:24.742448 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-862f0967-692d-47e1-826c-969b0ad64590 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.344070 Dec 27 14:22:24.745365 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e8cd4797-c127-4d87-b45b-034b49e1e3f2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:24.750158 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e8cd4797-c127-4d87-b45b-034b49e1e3f2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:24.751325 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e8cd4797-c127-4d87-b45b-034b49e1e3f2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:24.752216 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e8cd4797-c127-4d87-b45b-034b49e1e3f2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:24.752852 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 106/208] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:24 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:24.996600 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8fb60308-badb-455e-b605-b2c2e2b64efa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:24.999076 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8fb60308-badb-455e-b605-b2c2e2b64efa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:25.010511 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8fb60308-badb-455e-b605-b2c2e2b64efa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:25.014034 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8fb60308-badb-455e-b605-b2c2e2b64efa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:25.014958 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8fb60308-badb-455e-b605-b2c2e2b64efa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:25.015459 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8fb60308-badb-455e-b605-b2c2e2b64efa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:25.045722 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e8cd4797-c127-4d87-b45b-034b49e1e3f2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:25.063798 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e8cd4797-c127-4d87-b45b-034b49e1e3f2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.344695 Dec 27 14:22:25.065112 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 103/209] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:24 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:25.120781 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8fb60308-badb-455e-b605-b2c2e2b64efa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 20833 microversion: 2.1 time: 0.127994 Dec 27 14:22:25.121914 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 107/210] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:22:24 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 20833 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:22:25.314221 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-c740cca5-6578-46f0-833a-3b15c3527c4d req-e1bf7db7-d3af-4f19-bb09-7bc75bd201c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd94dbb7-24cb-4eef-9d37-088c69b3fc45", "tag": "f680b340-28a2-42f0-ac86-bdf63408f922"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:25.319459 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:22:25.319459 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:22:25.334587 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-c740cca5-6578-46f0-833a-3b15c3527c4d req-e1bf7db7-d3af-4f19-bb09-7bc75bd201c7 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:25.337030 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-c740cca5-6578-46f0-833a-3b15c3527c4d req-e1bf7db7-d3af-4f19-bb09-7bc75bd201c7 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:25.380015 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-c740cca5-6578-46f0-833a-3b15c3527c4d req-e1bf7db7-d3af-4f19-bb09-7bc75bd201c7 service nova] Creating event network-changed:f680b340-28a2-42f0-ac86-bdf63408f922 for instance cd94dbb7-24cb-4eef-9d37-088c69b3fc45 on hv-cinder-82301 Dec 27 14:22:25.391992 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-c740cca5-6578-46f0-833a-3b15c3527c4d req-e1bf7db7-d3af-4f19-bb09-7bc75bd201c7 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084917 Dec 27 14:22:25.397003 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 104/211] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:22:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:22:25.736153 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d439b925-79a8-4daa-8ec9-3a354b902c7a tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:25.737310 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d439b925-79a8-4daa-8ec9-3a354b902c7a tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:25.748911 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d439b925-79a8-4daa-8ec9-3a354b902c7a tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:25.755192 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d439b925-79a8-4daa-8ec9-3a354b902c7a tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:25.756691 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d439b925-79a8-4daa-8ec9-3a354b902c7a tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:25.757511 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d439b925-79a8-4daa-8ec9-3a354b902c7a tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:25.760931 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d6c20a56-e1ba-49cb-b769-5a3ac78afeae tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:25.761750 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d6c20a56-e1ba-49cb-b769-5a3ac78afeae tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:25.773275 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6c20a56-e1ba-49cb-b769-5a3ac78afeae tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:25.773726 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6c20a56-e1ba-49cb-b769-5a3ac78afeae tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:25.774696 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6c20a56-e1ba-49cb-b769-5a3ac78afeae tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:25.775106 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6c20a56-e1ba-49cb-b769-5a3ac78afeae tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:25.960362 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d439b925-79a8-4daa-8ec9-3a354b902c7a tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:25.969177 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d439b925-79a8-4daa-8ec9-3a354b902c7a tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1554 microversion: 2.1 time: 0.237666 Dec 27 14:22:25.969792 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 108/212] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:25 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1554 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:26.082564 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ddcfb688-0a3c-4237-b159-05166e0e201c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:26.084118 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ddcfb688-0a3c-4237-b159-05166e0e201c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:26.092140 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ddcfb688-0a3c-4237-b159-05166e0e201c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:26.092964 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ddcfb688-0a3c-4237-b159-05166e0e201c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:26.093974 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ddcfb688-0a3c-4237-b159-05166e0e201c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:26.094614 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ddcfb688-0a3c-4237-b159-05166e0e201c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:26.218756 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d6c20a56-e1ba-49cb-b769-5a3ac78afeae tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:26.234549 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d6c20a56-e1ba-49cb-b769-5a3ac78afeae tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.478752 Dec 27 14:22:26.235139 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 105/213] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:25 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:26.247925 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7a21ec9d-45c8-4227-9a11-bb4cb30358d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:26.249327 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7a21ec9d-45c8-4227-9a11-bb4cb30358d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:26.263721 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7a21ec9d-45c8-4227-9a11-bb4cb30358d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:26.264597 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7a21ec9d-45c8-4227-9a11-bb4cb30358d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:26.265548 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7a21ec9d-45c8-4227-9a11-bb4cb30358d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:26.266131 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7a21ec9d-45c8-4227-9a11-bb4cb30358d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:26.654001 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7a21ec9d-45c8-4227-9a11-bb4cb30358d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 22707 microversion: 2.1 time: 0.417275 Dec 27 14:22:26.654638 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 106/214] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:22:26 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 22707 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:22:26.665968 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ddcfb688-0a3c-4237-b159-05166e0e201c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:26.703963 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ddcfb688-0a3c-4237-b159-05166e0e201c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.610327 Dec 27 14:22:26.716981 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 109/215] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:26 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:26.995829 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e6c773a0-b3a6-470f-95e3-dd5d3a6980b2 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:26.997048 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e6c773a0-b3a6-470f-95e3-dd5d3a6980b2 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:27.020047 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6c773a0-b3a6-470f-95e3-dd5d3a6980b2 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:27.021606 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6c773a0-b3a6-470f-95e3-dd5d3a6980b2 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:27.027005 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6c773a0-b3a6-470f-95e3-dd5d3a6980b2 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:27.028069 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6c773a0-b3a6-470f-95e3-dd5d3a6980b2 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:27.181390 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-f45b043e-f899-4646-ac6b-cda5daa71157 req-34c2a548-8d86-45be-a0d6-aed76d024546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a23bf5-4a73-4f6b-97ba-2426322d63b1", "name": "network-vif-deleted", "tag": "839d0ed8-92c5-497f-a22d-8fe95743ee6c"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:27.186480 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:22:27.186480 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:22:27.215952 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-f45b043e-f899-4646-ac6b-cda5daa71157 req-34c2a548-8d86-45be-a0d6-aed76d024546 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:27.216403 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-f45b043e-f899-4646-ac6b-cda5daa71157 req-34c2a548-8d86-45be-a0d6-aed76d024546 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:27.250852 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-f45b043e-f899-4646-ac6b-cda5daa71157 req-34c2a548-8d86-45be-a0d6-aed76d024546 service nova] Creating event network-vif-deleted:839d0ed8-92c5-497f-a22d-8fe95743ee6c for instance c1a23bf5-4a73-4f6b-97ba-2426322d63b1 on hv-cinder-82301 Dec 27 14:22:27.263554 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-f45b043e-f899-4646-ac6b-cda5daa71157 req-34c2a548-8d86-45be-a0d6-aed76d024546 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092294 Dec 27 14:22:27.268053 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 110/216] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:22:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:22:27.276516 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b5c4b5dd-fffa-4fff-bcd8-57a59e410155 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:27.279141 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b5c4b5dd-fffa-4fff-bcd8-57a59e410155 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:27.287048 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5c4b5dd-fffa-4fff-bcd8-57a59e410155 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:27.287754 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5c4b5dd-fffa-4fff-bcd8-57a59e410155 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:27.288753 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5c4b5dd-fffa-4fff-bcd8-57a59e410155 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:27.289850 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b5c4b5dd-fffa-4fff-bcd8-57a59e410155 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:27.497309 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b5c4b5dd-fffa-4fff-bcd8-57a59e410155 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:27.506801 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b5c4b5dd-fffa-4fff-bcd8-57a59e410155 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.236632 Dec 27 14:22:27.509501 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 111/217] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:27 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:27.655973 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e6c773a0-b3a6-470f-95e3-dd5d3a6980b2 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:27.666241 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-54e3aaa8-fabe-4185-a1df-b431f3a961e1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:27.668025 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-54e3aaa8-fabe-4185-a1df-b431f3a961e1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:27.680951 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e6c773a0-b3a6-470f-95e3-dd5d3a6980b2 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1512 microversion: 2.1 time: 0.694978 Dec 27 14:22:27.691710 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54e3aaa8-fabe-4185-a1df-b431f3a961e1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:27.692283 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 107/218] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:26 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1512 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:27.692928 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54e3aaa8-fabe-4185-a1df-b431f3a961e1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:27.694174 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54e3aaa8-fabe-4185-a1df-b431f3a961e1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:27.694839 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54e3aaa8-fabe-4185-a1df-b431f3a961e1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:27.728154 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2c51013e-5db0-4af5-88d6-a4c90a0f4e1e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:27.728777 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2c51013e-5db0-4af5-88d6-a4c90a0f4e1e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:27.753321 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2c51013e-5db0-4af5-88d6-a4c90a0f4e1e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:27.753780 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2c51013e-5db0-4af5-88d6-a4c90a0f4e1e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:27.760174 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2c51013e-5db0-4af5-88d6-a4c90a0f4e1e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:27.760721 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2c51013e-5db0-4af5-88d6-a4c90a0f4e1e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:27.924330 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-54e3aaa8-fabe-4185-a1df-b431f3a961e1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 23222 microversion: 2.1 time: 0.261747 Dec 27 14:22:27.925592 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 112/219] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:22:27 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 23222 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:22:28.257781 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-2c51013e-5db0-4af5-88d6-a4c90a0f4e1e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:28.266963 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2c51013e-5db0-4af5-88d6-a4c90a0f4e1e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.548216 Dec 27 14:22:28.268618 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 108/220] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:27 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:28.526558 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7806a757-4a70-46d4-a6c1-cc55c42c89e0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:28.527217 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7806a757-4a70-46d4-a6c1-cc55c42c89e0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:28.535102 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7806a757-4a70-46d4-a6c1-cc55c42c89e0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:28.535559 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7806a757-4a70-46d4-a6c1-cc55c42c89e0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:28.536417 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7806a757-4a70-46d4-a6c1-cc55c42c89e0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:28.536852 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7806a757-4a70-46d4-a6c1-cc55c42c89e0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:28.702318 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ef317fdc-f957-4c15-8cc9-b42e77983302 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:28.703574 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ef317fdc-f957-4c15-8cc9-b42e77983302 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:28.730141 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ef317fdc-f957-4c15-8cc9-b42e77983302 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:28.731401 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ef317fdc-f957-4c15-8cc9-b42e77983302 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:28.734983 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ef317fdc-f957-4c15-8cc9-b42e77983302 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:28.740176 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ef317fdc-f957-4c15-8cc9-b42e77983302 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:28.758563 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7806a757-4a70-46d4-a6c1-cc55c42c89e0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:28.772062 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7806a757-4a70-46d4-a6c1-cc55c42c89e0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.250113 Dec 27 14:22:28.779471 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 113/221] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:28 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:28.801248 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ef317fdc-f957-4c15-8cc9-b42e77983302 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:28.802430 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ef317fdc-f957-4c15-8cc9-b42e77983302 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:28.803778 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.objects.instance [None req-ef317fdc-f957-4c15-8cc9-b42e77983302 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lazy-loading 'fault' on Instance uuid c1a23bf5-4a73-4f6b-97ba-2426322d63b1 {{(pid=116105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:22:28.896338 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ef317fdc-f957-4c15-8cc9-b42e77983302 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39da56a4e80e478eb32e7f096eb7396e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e37ac1308b3b47e2a00660c375407525', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:28.905399 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ef317fdc-f957-4c15-8cc9-b42e77983302 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 200 len: 1351 microversion: 2.1 time: 0.210757 Dec 27 14:22:28.905905 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 109/222] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:28 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 1351 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:28.942233 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a5946b8b-86e1-4b1e-8c8e-c595ee9ff0a2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:28.943372 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a5946b8b-86e1-4b1e-8c8e-c595ee9ff0a2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:28.954471 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a5946b8b-86e1-4b1e-8c8e-c595ee9ff0a2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:28.954964 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a5946b8b-86e1-4b1e-8c8e-c595ee9ff0a2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:28.955745 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a5946b8b-86e1-4b1e-8c8e-c595ee9ff0a2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:28.956286 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a5946b8b-86e1-4b1e-8c8e-c595ee9ff0a2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:29.287129 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e9f1d788-ad66-4138-a9c3-45e0f717fb58 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:29.287751 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e9f1d788-ad66-4138-a9c3-45e0f717fb58 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:29.294848 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e9f1d788-ad66-4138-a9c3-45e0f717fb58 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:29.295297 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e9f1d788-ad66-4138-a9c3-45e0f717fb58 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:29.296597 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e9f1d788-ad66-4138-a9c3-45e0f717fb58 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:29.297186 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e9f1d788-ad66-4138-a9c3-45e0f717fb58 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:29.505459 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e9f1d788-ad66-4138-a9c3-45e0f717fb58 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:29.525975 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e9f1d788-ad66-4138-a9c3-45e0f717fb58 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.236826 Dec 27 14:22:29.527723 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 110/223] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:29 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:29.800229 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b2227e0d-ffb0-47a3-ac26-0b0d4f009849 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:29.801728 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b2227e0d-ffb0-47a3-ac26-0b0d4f009849 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:29.814124 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b2227e0d-ffb0-47a3-ac26-0b0d4f009849 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:29.814587 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b2227e0d-ffb0-47a3-ac26-0b0d4f009849 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:29.815401 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b2227e0d-ffb0-47a3-ac26-0b0d4f009849 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:29.815874 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b2227e0d-ffb0-47a3-ac26-0b0d4f009849 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:30.119759 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b2227e0d-ffb0-47a3-ac26-0b0d4f009849 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:30.130200 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b2227e0d-ffb0-47a3-ac26-0b0d4f009849 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.334640 Dec 27 14:22:30.142232 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 111/224] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:29 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:30.148210 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-99787691-9410-428e-bdad-ee4d0031825f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:30.155013 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-99787691-9410-428e-bdad-ee4d0031825f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:30.162939 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99787691-9410-428e-bdad-ee4d0031825f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:30.163807 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99787691-9410-428e-bdad-ee4d0031825f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:30.165030 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99787691-9410-428e-bdad-ee4d0031825f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:30.165719 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99787691-9410-428e-bdad-ee4d0031825f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:30.191403 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-99787691-9410-428e-bdad-ee4d0031825f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] HTTP exception thrown: Instance c1a23bf5-4a73-4f6b-97ba-2426322d63b1 could not be found. Dec 27 14:22:30.192315 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-99787691-9410-428e-bdad-ee4d0031825f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Returning 404 to user: Instance c1a23bf5-4a73-4f6b-97ba-2426322d63b1 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:22:30.193314 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-99787691-9410-428e-bdad-ee4d0031825f tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 404 len: 111 microversion: 2.1 time: 0.049701 Dec 27 14:22:30.194197 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 112/225] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:30 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:22:30.367400 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-31349c37-2511-4163-be92-d1575eba8b92 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:30.368872 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-31349c37-2511-4163-be92-d1575eba8b92 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:30.384205 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31349c37-2511-4163-be92-d1575eba8b92 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:30.384914 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31349c37-2511-4163-be92-d1575eba8b92 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:30.385888 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31349c37-2511-4163-be92-d1575eba8b92 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:30.386476 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31349c37-2511-4163-be92-d1575eba8b92 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:30.407463 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-31349c37-2511-4163-be92-d1575eba8b92 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] HTTP exception thrown: Instance c1a23bf5-4a73-4f6b-97ba-2426322d63b1 could not be found. Dec 27 14:22:30.408497 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-31349c37-2511-4163-be92-d1575eba8b92 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Returning 404 to user: Instance c1a23bf5-4a73-4f6b-97ba-2426322d63b1 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:22:30.411724 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-31349c37-2511-4163-be92-d1575eba8b92 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.047977 Dec 27 14:22:30.418558 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 113/226] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:22:30 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1/os-volume_attachments => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:22:30.542674 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8de4d910-4cbe-4b2b-9c5f-393c42755f17 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:30.543721 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8de4d910-4cbe-4b2b-9c5f-393c42755f17 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:30.554101 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8de4d910-4cbe-4b2b-9c5f-393c42755f17 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:30.561869 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8de4d910-4cbe-4b2b-9c5f-393c42755f17 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:30.562724 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8de4d910-4cbe-4b2b-9c5f-393c42755f17 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:30.563462 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8de4d910-4cbe-4b2b-9c5f-393c42755f17 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:30.801819 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8de4d910-4cbe-4b2b-9c5f-393c42755f17 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:30.823036 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8de4d910-4cbe-4b2b-9c5f-393c42755f17 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.284643 Dec 27 14:22:30.825013 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 114/227] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:30 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:31.147990 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2d41f332-efb9-4ac1-a54d-6bc9dd5686bd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:31.148646 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2d41f332-efb9-4ac1-a54d-6bc9dd5686bd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:31.156771 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2d41f332-efb9-4ac1-a54d-6bc9dd5686bd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:31.157241 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2d41f332-efb9-4ac1-a54d-6bc9dd5686bd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:31.158018 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2d41f332-efb9-4ac1-a54d-6bc9dd5686bd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:31.158482 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2d41f332-efb9-4ac1-a54d-6bc9dd5686bd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:31.373417 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-2d41f332-efb9-4ac1-a54d-6bc9dd5686bd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:31.382196 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2d41f332-efb9-4ac1-a54d-6bc9dd5686bd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.237860 Dec 27 14:22:31.393307 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 115/228] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:31 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:31.842414 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-735575ef-645a-4ecd-b8a1-afb39fe14007 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:31.843063 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-735575ef-645a-4ecd-b8a1-afb39fe14007 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:31.850806 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-735575ef-645a-4ecd-b8a1-afb39fe14007 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:31.851626 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-735575ef-645a-4ecd-b8a1-afb39fe14007 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:31.853161 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-735575ef-645a-4ecd-b8a1-afb39fe14007 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:31.853830 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-735575ef-645a-4ecd-b8a1-afb39fe14007 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:32.018380 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-735575ef-645a-4ecd-b8a1-afb39fe14007 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:32.030193 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-735575ef-645a-4ecd-b8a1-afb39fe14007 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.191298 Dec 27 14:22:32.031774 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 116/229] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:31 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:32.400353 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e42a4141-5c09-4a8c-88c0-b0c6896b28c0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:32.400955 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e42a4141-5c09-4a8c-88c0-b0c6896b28c0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:32.407264 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e42a4141-5c09-4a8c-88c0-b0c6896b28c0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:32.407707 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e42a4141-5c09-4a8c-88c0-b0c6896b28c0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:32.408510 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e42a4141-5c09-4a8c-88c0-b0c6896b28c0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:32.409103 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e42a4141-5c09-4a8c-88c0-b0c6896b28c0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:32.756241 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e42a4141-5c09-4a8c-88c0-b0c6896b28c0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:32.774427 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e42a4141-5c09-4a8c-88c0-b0c6896b28c0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.373614 Dec 27 14:22:32.777319 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 117/230] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:32 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:33.048621 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1688a87a-7b7b-43dc-b161-a8f55c59473e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:33.049540 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1688a87a-7b7b-43dc-b161-a8f55c59473e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:33.059697 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1688a87a-7b7b-43dc-b161-a8f55c59473e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:33.062490 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1688a87a-7b7b-43dc-b161-a8f55c59473e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:33.063865 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1688a87a-7b7b-43dc-b161-a8f55c59473e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:33.064509 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1688a87a-7b7b-43dc-b161-a8f55c59473e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:33.249058 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1688a87a-7b7b-43dc-b161-a8f55c59473e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:33.276873 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1688a87a-7b7b-43dc-b161-a8f55c59473e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.232316 Dec 27 14:22:33.278249 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 118/231] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:33 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:33.791985 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-664cae92-2cf5-45fe-aac6-2d2ef54e2fbf tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:33.792585 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-664cae92-2cf5-45fe-aac6-2d2ef54e2fbf tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:33.802403 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-664cae92-2cf5-45fe-aac6-2d2ef54e2fbf tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:33.803034 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-664cae92-2cf5-45fe-aac6-2d2ef54e2fbf tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:33.804148 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-664cae92-2cf5-45fe-aac6-2d2ef54e2fbf tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:33.805537 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-664cae92-2cf5-45fe-aac6-2d2ef54e2fbf tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:33.953864 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-664cae92-2cf5-45fe-aac6-2d2ef54e2fbf tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:33.963040 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-664cae92-2cf5-45fe-aac6-2d2ef54e2fbf tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.174536 Dec 27 14:22:33.963608 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 119/232] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:33 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:34.294466 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d1f2ee58-2055-4cd5-bf57-c4aac62e79e3 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:34.296068 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d1f2ee58-2055-4cd5-bf57-c4aac62e79e3 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:34.303125 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d1f2ee58-2055-4cd5-bf57-c4aac62e79e3 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:34.303938 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d1f2ee58-2055-4cd5-bf57-c4aac62e79e3 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:34.305051 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d1f2ee58-2055-4cd5-bf57-c4aac62e79e3 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:34.305644 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d1f2ee58-2055-4cd5-bf57-c4aac62e79e3 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:34.450638 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d1f2ee58-2055-4cd5-bf57-c4aac62e79e3 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:34.460967 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d1f2ee58-2055-4cd5-bf57-c4aac62e79e3 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.170090 Dec 27 14:22:34.462137 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 120/233] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:34 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:34.821140 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a5946b8b-86e1-4b1e-8c8e-c595ee9ff0a2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 27485 microversion: 2.1 time: 5.888059 Dec 27 14:22:34.823858 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 114/234] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:22:28 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 27485 bytes in 5892 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:22:34.980752 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-bfdda469-d137-4885-b0f9-81bad37fe2c5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:34.980752 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-bfdda469-d137-4885-b0f9-81bad37fe2c5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:34.986820 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bfdda469-d137-4885-b0f9-81bad37fe2c5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:34.987270 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bfdda469-d137-4885-b0f9-81bad37fe2c5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:34.988238 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bfdda469-d137-4885-b0f9-81bad37fe2c5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:34.988680 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bfdda469-d137-4885-b0f9-81bad37fe2c5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:35.144624 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-bfdda469-d137-4885-b0f9-81bad37fe2c5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:35.155225 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-bfdda469-d137-4885-b0f9-81bad37fe2c5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.179311 Dec 27 14:22:35.157433 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 121/235] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:34 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:35.480814 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-61da0a5d-55f6-4bd4-9281-4f6155b0868e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:35.482146 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-61da0a5d-55f6-4bd4-9281-4f6155b0868e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:35.490379 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61da0a5d-55f6-4bd4-9281-4f6155b0868e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:35.490936 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61da0a5d-55f6-4bd4-9281-4f6155b0868e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:35.491826 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61da0a5d-55f6-4bd4-9281-4f6155b0868e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:35.492948 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61da0a5d-55f6-4bd4-9281-4f6155b0868e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:35.634434 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-61da0a5d-55f6-4bd4-9281-4f6155b0868e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:35.641833 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-61da0a5d-55f6-4bd4-9281-4f6155b0868e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.167908 Dec 27 14:22:35.642590 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 115/236] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:35 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:35.833021 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f0489356-67e6-43f4-80b1-47f9407cca18 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:35.833859 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f0489356-67e6-43f4-80b1-47f9407cca18 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:35.841838 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f0489356-67e6-43f4-80b1-47f9407cca18 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:35.842400 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f0489356-67e6-43f4-80b1-47f9407cca18 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:35.843283 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f0489356-67e6-43f4-80b1-47f9407cca18 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:35.843808 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f0489356-67e6-43f4-80b1-47f9407cca18 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:36.005879 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f0489356-67e6-43f4-80b1-47f9407cca18 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 27719 microversion: 2.1 time: 0.176502 Dec 27 14:22:36.007252 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 122/237] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:22:35 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 27719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:22:36.173736 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-54404e4d-c2ef-4354-9cde-f940d5b32c83 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:36.174429 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-54404e4d-c2ef-4354-9cde-f940d5b32c83 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:36.181435 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54404e4d-c2ef-4354-9cde-f940d5b32c83 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:36.181883 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54404e4d-c2ef-4354-9cde-f940d5b32c83 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:36.182684 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54404e4d-c2ef-4354-9cde-f940d5b32c83 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:36.183117 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54404e4d-c2ef-4354-9cde-f940d5b32c83 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:36.353126 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-54404e4d-c2ef-4354-9cde-f940d5b32c83 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:36.360413 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-54404e4d-c2ef-4354-9cde-f940d5b32c83 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.190674 Dec 27 14:22:36.361706 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 116/238] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:36 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:36.659345 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9f839b5d-a40b-4cc4-858b-d9b62152f2ee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:36.659999 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9f839b5d-a40b-4cc4-858b-d9b62152f2ee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:36.666973 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9f839b5d-a40b-4cc4-858b-d9b62152f2ee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:36.667431 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9f839b5d-a40b-4cc4-858b-d9b62152f2ee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:36.675478 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9f839b5d-a40b-4cc4-858b-d9b62152f2ee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:36.675960 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9f839b5d-a40b-4cc4-858b-d9b62152f2ee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:36.842425 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9f839b5d-a40b-4cc4-858b-d9b62152f2ee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:36.849616 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9f839b5d-a40b-4cc4-858b-d9b62152f2ee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.194575 Dec 27 14:22:36.850350 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 123/239] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:36 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:36.956480 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b9f140ea-15c4-4232-8b0d-abdff0e386f7 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Action: 'create', calling method: .version_select at 0x7f8028e76820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1327463049"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:36.976958 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-b9f140ea-15c4-4232-8b0d-abdff0e386f7 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Getting quotas for project ca837abe525d4bf89957e0a02b5d06d4. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:22:36.980946 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-b9f140ea-15c4-4232-8b0d-abdff0e386f7 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Getting quotas for user 42c3f50b20424a43a00425b9c779a39b and project ca837abe525d4bf89957e0a02b5d06d4. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:22:37.020876 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f2631372-15d9-46c4-9230-7eee7fb85f6f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:37.022110 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f2631372-15d9-46c4-9230-7eee7fb85f6f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:37.029216 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f2631372-15d9-46c4-9230-7eee7fb85f6f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:37.029689 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f2631372-15d9-46c4-9230-7eee7fb85f6f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:37.030476 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f2631372-15d9-46c4-9230-7eee7fb85f6f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:37.030921 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f2631372-15d9-46c4-9230-7eee7fb85f6f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:37.164496 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-b9f140ea-15c4-4232-8b0d-abdff0e386f7 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Getting quotas for project ca837abe525d4bf89957e0a02b5d06d4. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:22:37.168366 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-b9f140ea-15c4-4232-8b0d-abdff0e386f7 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Getting quotas for user 42c3f50b20424a43a00425b9c779a39b and project ca837abe525d4bf89957e0a02b5d06d4. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:22:37.182163 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b9f140ea-15c4-4232-8b0d-abdff0e386f7 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.229416 Dec 27 14:22:37.182813 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 117/240] 10.222.0.37 () {60 vars in 1157 bytes} [Mon Dec 27 14:22:36 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:37.233849 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f2631372-15d9-46c4-9230-7eee7fb85f6f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 27802 microversion: 2.1 time: 0.219128 Dec 27 14:22:37.234505 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 124/241] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:22:37 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 27802 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:22:37.277926 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-293a88f0-de75-4568-8aa3-288ac9cb410b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-953800868", "imageRef": "cc3e8770-10df-4f75-91e4-e568c919fd48", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1327463049", "networks": [{"uuid": "e0b1a136-9a99-44cd-9b9f-4c00d8db84f5"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:37.332072 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-293a88f0-de75-4568-8aa3-288ac9cb410b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] validate_networks() for [('e0b1a136-9a99-44cd-9b9f-4c00d8db84f5', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 27 14:22:37.377882 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-35e40625-bfc8-4dc0-9288-0c16fabdd927 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:37.378584 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-35e40625-bfc8-4dc0-9288-0c16fabdd927 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:37.386273 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-35e40625-bfc8-4dc0-9288-0c16fabdd927 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:37.386735 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-35e40625-bfc8-4dc0-9288-0c16fabdd927 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:37.387704 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-35e40625-bfc8-4dc0-9288-0c16fabdd927 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:37.388458 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-35e40625-bfc8-4dc0-9288-0c16fabdd927 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:37.561046 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-35e40625-bfc8-4dc0-9288-0c16fabdd927 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:37.568741 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-35e40625-bfc8-4dc0-9288-0c16fabdd927 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.194806 Dec 27 14:22:37.569313 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 125/242] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:37 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:37.741052 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-293a88f0-de75-4568-8aa3-288ac9cb410b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 27 14:22:37.741478 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-293a88f0-de75-4568-8aa3-288ac9cb410b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 27 14:22:37.742903 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-293a88f0-de75-4568-8aa3-288ac9cb410b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 27 14:22:37.743466 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-293a88f0-de75-4568-8aa3-288ac9cb410b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 27 14:22:37.744166 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-293a88f0-de75-4568-8aa3-288ac9cb410b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 27 14:22:37.755583 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-293a88f0-de75-4568-8aa3-288ac9cb410b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:37.756084 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-293a88f0-de75-4568-8aa3-288ac9cb410b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:37.757072 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-293a88f0-de75-4568-8aa3-288ac9cb410b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:37.757569 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-293a88f0-de75-4568-8aa3-288ac9cb410b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:37.776684 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-293a88f0-de75-4568-8aa3-288ac9cb410b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Getting quotas for project ca837abe525d4bf89957e0a02b5d06d4. Resources: {'cores', 'ram', 'instances'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:22:37.781695 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-293a88f0-de75-4568-8aa3-288ac9cb410b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Getting quotas for user 42c3f50b20424a43a00425b9c779a39b and project ca837abe525d4bf89957e0a02b5d06d4. Resources: {'cores', 'ram', 'instances'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:22:37.793992 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-293a88f0-de75-4568-8aa3-288ac9cb410b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 27 14:22:37.797149 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-293a88f0-de75-4568-8aa3-288ac9cb410b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cc3e8770-10df-4f75-91e4-e568c919fd48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 27 14:22:37.857890 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-293a88f0-de75-4568-8aa3-288ac9cb410b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584212 Dec 27 14:22:37.858538 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 118/243] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Dec 27 14:22:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 27 14:22:37.866336 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-970c0292-487b-4449-9481-3c98b5e373da tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:37.868331 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2ee7f0e3-f8b6-4ea6-867c-35d64abb50e0 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:37.868986 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2ee7f0e3-f8b6-4ea6-867c-35d64abb50e0 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:37.869996 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-970c0292-487b-4449-9481-3c98b5e373da tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:37.885647 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-970c0292-487b-4449-9481-3c98b5e373da tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:37.892593 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-970c0292-487b-4449-9481-3c98b5e373da tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:37.893528 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-970c0292-487b-4449-9481-3c98b5e373da tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:37.896428 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-970c0292-487b-4449-9481-3c98b5e373da tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:37.940430 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2ee7f0e3-f8b6-4ea6-867c-35d64abb50e0 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:37.951620 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2ee7f0e3-f8b6-4ea6-867c-35d64abb50e0 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1258 microversion: 2.1 time: 0.087319 Dec 27 14:22:37.952230 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 119/244] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:37 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1258 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:38.026929 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-45acc95b-eca0-4a05-945d-4ffb3bfbdb56 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:38.028093 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-45acc95b-eca0-4a05-945d-4ffb3bfbdb56 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:38.036878 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45acc95b-eca0-4a05-945d-4ffb3bfbdb56 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:38.037710 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45acc95b-eca0-4a05-945d-4ffb3bfbdb56 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:38.038774 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45acc95b-eca0-4a05-945d-4ffb3bfbdb56 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:38.039484 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45acc95b-eca0-4a05-945d-4ffb3bfbdb56 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:38.062706 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-45acc95b-eca0-4a05-945d-4ffb3bfbdb56 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] HTTP exception thrown: Instance c1a23bf5-4a73-4f6b-97ba-2426322d63b1 could not be found. Dec 27 14:22:38.063522 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-45acc95b-eca0-4a05-945d-4ffb3bfbdb56 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Returning 404 to user: Instance c1a23bf5-4a73-4f6b-97ba-2426322d63b1 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:22:38.064450 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-45acc95b-eca0-4a05-945d-4ffb3bfbdb56 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "DELETE /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 404 len: 111 microversion: 2.1 time: 0.042322 Dec 27 14:22:38.065176 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 120/245] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Dec 27 14:22:38 2021] DELETE /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 27 14:22:38.074333 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e8ada2a3-659c-4e64-ab0b-e7a462e27ad7 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:38.074946 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e8ada2a3-659c-4e64-ab0b-e7a462e27ad7 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] [instance: c1a23bf5-4a73-4f6b-97ba-2426322d63b1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:38.083372 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8ada2a3-659c-4e64-ab0b-e7a462e27ad7 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:38.083573 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-970c0292-487b-4449-9481-3c98b5e373da tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:38.083685 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8ada2a3-659c-4e64-ab0b-e7a462e27ad7 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:38.083963 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8ada2a3-659c-4e64-ab0b-e7a462e27ad7 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:38.084464 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e8ada2a3-659c-4e64-ab0b-e7a462e27ad7 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:38.092872 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-970c0292-487b-4449-9481-3c98b5e373da tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.229875 Dec 27 14:22:38.094124 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 126/246] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:37 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:38.102809 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-e8ada2a3-659c-4e64-ab0b-e7a462e27ad7 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] HTTP exception thrown: Instance c1a23bf5-4a73-4f6b-97ba-2426322d63b1 could not be found. Dec 27 14:22:38.103549 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e8ada2a3-659c-4e64-ab0b-e7a462e27ad7 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] Returning 404 to user: Instance c1a23bf5-4a73-4f6b-97ba-2426322d63b1 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:22:38.104541 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e8ada2a3-659c-4e64-ab0b-e7a462e27ad7 tempest-DeleteServersTestJSON-1120777819 tempest-DeleteServersTestJSON-1120777819-project] 10.222.0.37 "GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1" status: 404 len: 111 microversion: 2.1 time: 0.034968 Dec 27 14:22:38.105381 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 121/247] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:38 2021] GET /compute/v2.1/servers/c1a23bf5-4a73-4f6b-97ba-2426322d63b1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:22:38.250718 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5298060a-a827-4f63-960a-21e53e8f10fe tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:38.252658 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5298060a-a827-4f63-960a-21e53e8f10fe tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:38.264159 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5298060a-a827-4f63-960a-21e53e8f10fe tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:38.266510 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5298060a-a827-4f63-960a-21e53e8f10fe tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:38.267636 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5298060a-a827-4f63-960a-21e53e8f10fe tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:38.268547 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5298060a-a827-4f63-960a-21e53e8f10fe tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:38.384852 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5298060a-a827-4f63-960a-21e53e8f10fe tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 27961 microversion: 2.1 time: 0.141661 Dec 27 14:22:38.385512 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 127/248] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:22:38 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 27961 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:22:38.587165 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9ec08fc8-2544-45a6-8709-4a544848b62d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:38.587787 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9ec08fc8-2544-45a6-8709-4a544848b62d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:38.594135 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ec08fc8-2544-45a6-8709-4a544848b62d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:38.594716 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ec08fc8-2544-45a6-8709-4a544848b62d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:38.595613 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ec08fc8-2544-45a6-8709-4a544848b62d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:38.596255 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ec08fc8-2544-45a6-8709-4a544848b62d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:38.755796 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9ec08fc8-2544-45a6-8709-4a544848b62d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:38.764910 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9ec08fc8-2544-45a6-8709-4a544848b62d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.182472 Dec 27 14:22:38.765595 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 122/249] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:38 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:38.929218 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-916ceb65-bd1f-4bea-b219-fd0b06c33438 req-59eaaf77-e1c5-4758-9048-716fc7ee52fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd94dbb7-24cb-4eef-9d37-088c69b3fc45", "name": "network-vif-plugged", "status": "completed", "tag": "f680b340-28a2-42f0-ac86-bdf63408f922"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:38.934421 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:22:38.934421 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:22:38.947739 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-916ceb65-bd1f-4bea-b219-fd0b06c33438 req-59eaaf77-e1c5-4758-9048-716fc7ee52fb service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:38.948501 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-916ceb65-bd1f-4bea-b219-fd0b06c33438 req-59eaaf77-e1c5-4758-9048-716fc7ee52fb service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:38.963007 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-916ceb65-bd1f-4bea-b219-fd0b06c33438 req-59eaaf77-e1c5-4758-9048-716fc7ee52fb service nova] Creating event network-vif-plugged:f680b340-28a2-42f0-ac86-bdf63408f922 for instance cd94dbb7-24cb-4eef-9d37-088c69b3fc45 on hv-cinder-82301 Dec 27 14:22:38.969512 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-32607710-fd65-4302-b1bd-883980c59762 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:38.969729 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-916ceb65-bd1f-4bea-b219-fd0b06c33438 req-59eaaf77-e1c5-4758-9048-716fc7ee52fb service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051839 Dec 27 14:22:38.970114 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-32607710-fd65-4302-b1bd-883980c59762 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:38.971032 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 128/250] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:22:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:22:39.004433 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32607710-fd65-4302-b1bd-883980c59762 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:39.004895 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32607710-fd65-4302-b1bd-883980c59762 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:39.015588 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32607710-fd65-4302-b1bd-883980c59762 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:39.016290 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32607710-fd65-4302-b1bd-883980c59762 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:39.111347 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-36d4e83b-84a7-428c-9a08-f6a0e63fe0e7 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:39.112132 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-36d4e83b-84a7-428c-9a08-f6a0e63fe0e7 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:39.122464 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-36d4e83b-84a7-428c-9a08-f6a0e63fe0e7 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:39.122931 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-36d4e83b-84a7-428c-9a08-f6a0e63fe0e7 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:39.123730 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-36d4e83b-84a7-428c-9a08-f6a0e63fe0e7 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:39.135183 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-36d4e83b-84a7-428c-9a08-f6a0e63fe0e7 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:39.145185 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-32607710-fd65-4302-b1bd-883980c59762 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:39.159754 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-32607710-fd65-4302-b1bd-883980c59762 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1310 microversion: 2.1 time: 0.194017 Dec 27 14:22:39.166608 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 123/251] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:38 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1310 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:39.397329 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cdefab73-5f04-4793-a3b7-288d3ce5ccb8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:39.399179 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cdefab73-5f04-4793-a3b7-288d3ce5ccb8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:39.405394 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cdefab73-5f04-4793-a3b7-288d3ce5ccb8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:39.405952 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cdefab73-5f04-4793-a3b7-288d3ce5ccb8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:39.407113 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cdefab73-5f04-4793-a3b7-288d3ce5ccb8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:39.407617 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cdefab73-5f04-4793-a3b7-288d3ce5ccb8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:39.498095 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-36d4e83b-84a7-428c-9a08-f6a0e63fe0e7 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:39.505975 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-36d4e83b-84a7-428c-9a08-f6a0e63fe0e7 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.399227 Dec 27 14:22:39.511168 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 129/252] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:39 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:39.753047 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cdefab73-5f04-4793-a3b7-288d3ce5ccb8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28143 microversion: 2.1 time: 0.359399 Dec 27 14:22:39.759130 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 124/253] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:22:39 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28143 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:22:39.787609 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-23afc599-3973-4a6a-868d-acbbb03e6460 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:39.788786 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-23afc599-3973-4a6a-868d-acbbb03e6460 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:39.795909 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-23afc599-3973-4a6a-868d-acbbb03e6460 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:39.797465 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-23afc599-3973-4a6a-868d-acbbb03e6460 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:39.799626 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-23afc599-3973-4a6a-868d-acbbb03e6460 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:39.800114 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-23afc599-3973-4a6a-868d-acbbb03e6460 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:40.042612 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-23afc599-3973-4a6a-868d-acbbb03e6460 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:40.053457 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-23afc599-3973-4a6a-868d-acbbb03e6460 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.274325 Dec 27 14:22:40.055100 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 130/254] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:39 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:40.181991 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6f8fee05-773a-4f46-88de-2effb4d04881 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:40.182844 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6f8fee05-773a-4f46-88de-2effb4d04881 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:40.191934 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f8fee05-773a-4f46-88de-2effb4d04881 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:40.193028 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f8fee05-773a-4f46-88de-2effb4d04881 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:40.193946 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f8fee05-773a-4f46-88de-2effb4d04881 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:40.194535 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f8fee05-773a-4f46-88de-2effb4d04881 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:40.391585 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6f8fee05-773a-4f46-88de-2effb4d04881 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:40.407009 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6f8fee05-773a-4f46-88de-2effb4d04881 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1358 microversion: 2.1 time: 0.230513 Dec 27 14:22:40.408666 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 125/255] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:40 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:40.530845 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f55d43ae-c84c-4ab8-95de-59fe4f2a739f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:40.534090 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f55d43ae-c84c-4ab8-95de-59fe4f2a739f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:40.553921 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f55d43ae-c84c-4ab8-95de-59fe4f2a739f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:40.556498 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f55d43ae-c84c-4ab8-95de-59fe4f2a739f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:40.562058 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f55d43ae-c84c-4ab8-95de-59fe4f2a739f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:40.563723 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f55d43ae-c84c-4ab8-95de-59fe4f2a739f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:40.767631 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-03e760bb-4ce6-4815-a068-4aa59d4508dd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:40.768747 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-03e760bb-4ce6-4815-a068-4aa59d4508dd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:40.788732 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03e760bb-4ce6-4815-a068-4aa59d4508dd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:40.790574 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03e760bb-4ce6-4815-a068-4aa59d4508dd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:40.792963 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03e760bb-4ce6-4815-a068-4aa59d4508dd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:40.799532 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03e760bb-4ce6-4815-a068-4aa59d4508dd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:41.092597 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f55d43ae-c84c-4ab8-95de-59fe4f2a739f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:41.103004 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f55d43ae-c84c-4ab8-95de-59fe4f2a739f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.576112 Dec 27 14:22:41.114795 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 131/256] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:40 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:41.134622 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-860eef21-4b91-43cb-a5d9-0b05e2974fb9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:41.136168 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-860eef21-4b91-43cb-a5d9-0b05e2974fb9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:41.144148 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-860eef21-4b91-43cb-a5d9-0b05e2974fb9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:41.145117 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-860eef21-4b91-43cb-a5d9-0b05e2974fb9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:41.146809 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-860eef21-4b91-43cb-a5d9-0b05e2974fb9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:41.147504 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-860eef21-4b91-43cb-a5d9-0b05e2974fb9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:41.527305 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-860eef21-4b91-43cb-a5d9-0b05e2974fb9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:41.541203 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-860eef21-4b91-43cb-a5d9-0b05e2974fb9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.411924 Dec 27 14:22:41.552810 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 132/257] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:41 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:41.564281 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-72fa1405-0c01-44ee-85fd-313f8eff61c4 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:41.565748 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-72fa1405-0c01-44ee-85fd-313f8eff61c4 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:41.580290 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72fa1405-0c01-44ee-85fd-313f8eff61c4 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:41.583120 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72fa1405-0c01-44ee-85fd-313f8eff61c4 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:41.584193 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72fa1405-0c01-44ee-85fd-313f8eff61c4 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:41.590083 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72fa1405-0c01-44ee-85fd-313f8eff61c4 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:42.119275 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-72fa1405-0c01-44ee-85fd-313f8eff61c4 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:42.162247 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-72fa1405-0c01-44ee-85fd-313f8eff61c4 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1358 microversion: 2.1 time: 0.605978 Dec 27 14:22:42.165350 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 133/258] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:41 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1358 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:42.176048 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-2b33046a-68ba-48e0-a92b-144f79eb974a req-7ffa6907-3e49-4f69-b3a7-bf63bc4b7588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ff5786-5d44-438e-bb0a-f3fd05d83e40", "tag": "7e953f6b-a948-41fc-94f1-b04996e676ac"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:42.181204 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:22:42.181204 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:22:42.207273 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-2b33046a-68ba-48e0-a92b-144f79eb974a req-7ffa6907-3e49-4f69-b3a7-bf63bc4b7588 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:42.208116 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-2b33046a-68ba-48e0-a92b-144f79eb974a req-7ffa6907-3e49-4f69-b3a7-bf63bc4b7588 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:42.238750 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-2b33046a-68ba-48e0-a92b-144f79eb974a req-7ffa6907-3e49-4f69-b3a7-bf63bc4b7588 service nova] Creating event network-changed:7e953f6b-a948-41fc-94f1-b04996e676ac for instance 29ff5786-5d44-438e-bb0a-f3fd05d83e40 on hv-cinder-82301 Dec 27 14:22:42.252977 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-2b33046a-68ba-48e0-a92b-144f79eb974a req-7ffa6907-3e49-4f69-b3a7-bf63bc4b7588 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086154 Dec 27 14:22:42.259904 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 134/259] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:22:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:22:42.290060 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3280fc61-b8d9-42cf-a4e5-aa3fd35dc025 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:42.292772 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3280fc61-b8d9-42cf-a4e5-aa3fd35dc025 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:42.309875 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3280fc61-b8d9-42cf-a4e5-aa3fd35dc025 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:42.310493 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3280fc61-b8d9-42cf-a4e5-aa3fd35dc025 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:42.311478 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3280fc61-b8d9-42cf-a4e5-aa3fd35dc025 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:42.312091 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3280fc61-b8d9-42cf-a4e5-aa3fd35dc025 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:42.596669 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3280fc61-b8d9-42cf-a4e5-aa3fd35dc025 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:42.612578 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3280fc61-b8d9-42cf-a4e5-aa3fd35dc025 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.351124 Dec 27 14:22:42.613456 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 135/260] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:42 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:42.628237 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5aa44fa4-1770-495f-80a8-0b250c501f10 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:42.628852 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5aa44fa4-1770-495f-80a8-0b250c501f10 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:42.642665 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5aa44fa4-1770-495f-80a8-0b250c501f10 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:42.642665 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5aa44fa4-1770-495f-80a8-0b250c501f10 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:42.642665 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5aa44fa4-1770-495f-80a8-0b250c501f10 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:42.642665 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5aa44fa4-1770-495f-80a8-0b250c501f10 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:42.977123 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5aa44fa4-1770-495f-80a8-0b250c501f10 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:42.987396 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5aa44fa4-1770-495f-80a8-0b250c501f10 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.371428 Dec 27 14:22:42.988728 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 136/261] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:42 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:43.195536 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-65b8335b-4174-45c1-8c89-9e6b8e9311a3 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:43.201869 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-65b8335b-4174-45c1-8c89-9e6b8e9311a3 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:43.209071 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65b8335b-4174-45c1-8c89-9e6b8e9311a3 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:43.209544 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65b8335b-4174-45c1-8c89-9e6b8e9311a3 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:43.210958 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65b8335b-4174-45c1-8c89-9e6b8e9311a3 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:43.211944 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65b8335b-4174-45c1-8c89-9e6b8e9311a3 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:43.470068 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-65b8335b-4174-45c1-8c89-9e6b8e9311a3 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:43.479038 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-65b8335b-4174-45c1-8c89-9e6b8e9311a3 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1358 microversion: 2.1 time: 0.300978 Dec 27 14:22:43.495286 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 137/262] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:43 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1358 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:43.630492 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a5a3f314-0f82-4d29-9e13-a1afb53f669f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:43.631097 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a5a3f314-0f82-4d29-9e13-a1afb53f669f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:43.653422 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a5a3f314-0f82-4d29-9e13-a1afb53f669f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:43.654317 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a5a3f314-0f82-4d29-9e13-a1afb53f669f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:43.655124 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a5a3f314-0f82-4d29-9e13-a1afb53f669f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:43.658591 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a5a3f314-0f82-4d29-9e13-a1afb53f669f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:43.990663 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a5a3f314-0f82-4d29-9e13-a1afb53f669f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:44.000954 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a5a3f314-0f82-4d29-9e13-a1afb53f669f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.373986 Dec 27 14:22:44.004553 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 138/263] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:43 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:44.018642 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-03cce767-d6f0-44e3-85d3-7b303fbeee84 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:44.023091 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-03cce767-d6f0-44e3-85d3-7b303fbeee84 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:44.041698 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-03cce767-d6f0-44e3-85d3-7b303fbeee84 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:44.043174 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-03cce767-d6f0-44e3-85d3-7b303fbeee84 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:44.048176 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-03cce767-d6f0-44e3-85d3-7b303fbeee84 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:44.049256 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-03cce767-d6f0-44e3-85d3-7b303fbeee84 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:44.402755 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-03cce767-d6f0-44e3-85d3-7b303fbeee84 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:44.412756 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-03cce767-d6f0-44e3-85d3-7b303fbeee84 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.401315 Dec 27 14:22:44.414603 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 139/264] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:44 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:44.509376 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e3f248a0-1360-4ccc-b828-ecf11632c4bf tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:44.510100 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e3f248a0-1360-4ccc-b828-ecf11632c4bf tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:44.522489 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e3f248a0-1360-4ccc-b828-ecf11632c4bf tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:44.524302 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e3f248a0-1360-4ccc-b828-ecf11632c4bf tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:44.525743 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e3f248a0-1360-4ccc-b828-ecf11632c4bf tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:44.527874 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e3f248a0-1360-4ccc-b828-ecf11632c4bf tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:44.729442 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e3f248a0-1360-4ccc-b828-ecf11632c4bf tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:44.739407 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e3f248a0-1360-4ccc-b828-ecf11632c4bf tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1358 microversion: 2.1 time: 0.242518 Dec 27 14:22:44.740658 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 140/265] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:44 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:45.021712 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f3143a1b-b847-41fb-8858-324232585a81 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:45.022864 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f3143a1b-b847-41fb-8858-324232585a81 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:45.030481 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f3143a1b-b847-41fb-8858-324232585a81 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:45.031223 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f3143a1b-b847-41fb-8858-324232585a81 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:45.032668 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f3143a1b-b847-41fb-8858-324232585a81 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:45.033270 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f3143a1b-b847-41fb-8858-324232585a81 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:45.305157 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f3143a1b-b847-41fb-8858-324232585a81 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:45.313141 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f3143a1b-b847-41fb-8858-324232585a81 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.295040 Dec 27 14:22:45.324076 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 141/266] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:45 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:45.431097 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-08e776e5-1b41-48a5-8f32-4cda7c0a6a76 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:45.432635 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-08e776e5-1b41-48a5-8f32-4cda7c0a6a76 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:45.438870 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-08e776e5-1b41-48a5-8f32-4cda7c0a6a76 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:45.439527 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-08e776e5-1b41-48a5-8f32-4cda7c0a6a76 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:45.440525 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-08e776e5-1b41-48a5-8f32-4cda7c0a6a76 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:45.441113 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-08e776e5-1b41-48a5-8f32-4cda7c0a6a76 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:45.715954 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-08e776e5-1b41-48a5-8f32-4cda7c0a6a76 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:45.723328 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-08e776e5-1b41-48a5-8f32-4cda7c0a6a76 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.297569 Dec 27 14:22:45.737164 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 142/267] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:45 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:45.756714 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-281308cc-b3b3-4dc3-9788-61b9a5000b27 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:45.757400 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-281308cc-b3b3-4dc3-9788-61b9a5000b27 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:45.765505 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-281308cc-b3b3-4dc3-9788-61b9a5000b27 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:45.766200 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-281308cc-b3b3-4dc3-9788-61b9a5000b27 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:45.767363 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-281308cc-b3b3-4dc3-9788-61b9a5000b27 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:45.768538 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-281308cc-b3b3-4dc3-9788-61b9a5000b27 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:46.050282 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-281308cc-b3b3-4dc3-9788-61b9a5000b27 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:46.065419 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-281308cc-b3b3-4dc3-9788-61b9a5000b27 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1358 microversion: 2.1 time: 0.312221 Dec 27 14:22:46.066783 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 143/268] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:45 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1358 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:46.344246 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b8285bf1-83a4-4186-a3d5-5938af9889c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:46.345126 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b8285bf1-83a4-4186-a3d5-5938af9889c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:46.365973 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b8285bf1-83a4-4186-a3d5-5938af9889c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:46.366580 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b8285bf1-83a4-4186-a3d5-5938af9889c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:46.371803 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b8285bf1-83a4-4186-a3d5-5938af9889c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:46.372454 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b8285bf1-83a4-4186-a3d5-5938af9889c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:47.202399 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b8285bf1-83a4-4186-a3d5-5938af9889c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:47.215925 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b8285bf1-83a4-4186-a3d5-5938af9889c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.889082 Dec 27 14:22:47.226226 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 144/269] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:46 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:47.230584 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b6f5ea4f-a255-4962-a1b1-8127c914cea1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:47.231290 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b6f5ea4f-a255-4962-a1b1-8127c914cea1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:47.240905 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b6f5ea4f-a255-4962-a1b1-8127c914cea1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:47.242286 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b6f5ea4f-a255-4962-a1b1-8127c914cea1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:47.243275 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b6f5ea4f-a255-4962-a1b1-8127c914cea1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:47.244546 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b6f5ea4f-a255-4962-a1b1-8127c914cea1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:47.531095 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b6f5ea4f-a255-4962-a1b1-8127c914cea1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:47.566088 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b6f5ea4f-a255-4962-a1b1-8127c914cea1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.340245 Dec 27 14:22:47.567819 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 145/270] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:47 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:47.579745 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b51dc822-0106-4964-bf72-ccf77fff966b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:47.580389 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b51dc822-0106-4964-bf72-ccf77fff966b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:47.592933 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b51dc822-0106-4964-bf72-ccf77fff966b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:47.593788 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b51dc822-0106-4964-bf72-ccf77fff966b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:47.594965 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b51dc822-0106-4964-bf72-ccf77fff966b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:47.594965 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b51dc822-0106-4964-bf72-ccf77fff966b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:48.106298 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b51dc822-0106-4964-bf72-ccf77fff966b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:48.120292 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b51dc822-0106-4964-bf72-ccf77fff966b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1358 microversion: 2.1 time: 0.547756 Dec 27 14:22:48.120931 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 146/271] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:47 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1358 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:48.234130 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-38359823-9f7f-4965-bd5a-1270936fbea9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:48.235530 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-38359823-9f7f-4965-bd5a-1270936fbea9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:48.246900 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-38359823-9f7f-4965-bd5a-1270936fbea9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:48.247698 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-38359823-9f7f-4965-bd5a-1270936fbea9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:48.248761 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-38359823-9f7f-4965-bd5a-1270936fbea9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:48.249389 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-38359823-9f7f-4965-bd5a-1270936fbea9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:48.681661 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-38359823-9f7f-4965-bd5a-1270936fbea9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:48.704757 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-38359823-9f7f-4965-bd5a-1270936fbea9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.467872 Dec 27 14:22:48.704757 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 147/272] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:48 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:48.719276 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-53867d7b-7df2-4625-94e2-04971471a6cb tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:48.724193 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-53867d7b-7df2-4625-94e2-04971471a6cb tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:48.744382 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-53867d7b-7df2-4625-94e2-04971471a6cb tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:48.748576 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-53867d7b-7df2-4625-94e2-04971471a6cb tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:48.755151 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-53867d7b-7df2-4625-94e2-04971471a6cb tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:48.756113 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-53867d7b-7df2-4625-94e2-04971471a6cb tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:49.245647 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-53867d7b-7df2-4625-94e2-04971471a6cb tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:49.254040 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-53867d7b-7df2-4625-94e2-04971471a6cb tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.552746 Dec 27 14:22:49.254623 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 148/273] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:48 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:49.264753 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fc6277e8-863a-4eeb-a379-424ea5bfd29c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:49.265630 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fc6277e8-863a-4eeb-a379-424ea5bfd29c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:49.278483 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fc6277e8-863a-4eeb-a379-424ea5bfd29c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:49.278859 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fc6277e8-863a-4eeb-a379-424ea5bfd29c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:49.279691 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fc6277e8-863a-4eeb-a379-424ea5bfd29c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:49.280126 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fc6277e8-863a-4eeb-a379-424ea5bfd29c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:49.608110 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-fc6277e8-863a-4eeb-a379-424ea5bfd29c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:49.618651 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fc6277e8-863a-4eeb-a379-424ea5bfd29c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1358 microversion: 2.1 time: 0.360729 Dec 27 14:22:49.620176 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 149/274] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:49 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1358 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:49.732516 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4141c4db-ae7a-40a2-9328-5fa6a7ab09a9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:49.733695 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4141c4db-ae7a-40a2-9328-5fa6a7ab09a9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:49.741271 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4141c4db-ae7a-40a2-9328-5fa6a7ab09a9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:49.742877 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4141c4db-ae7a-40a2-9328-5fa6a7ab09a9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:49.744175 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4141c4db-ae7a-40a2-9328-5fa6a7ab09a9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:49.744912 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4141c4db-ae7a-40a2-9328-5fa6a7ab09a9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:50.202711 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4141c4db-ae7a-40a2-9328-5fa6a7ab09a9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:50.216020 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4141c4db-ae7a-40a2-9328-5fa6a7ab09a9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.492636 Dec 27 14:22:50.216608 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 150/275] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:49 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:50.270687 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-bdb0e039-8df5-40f9-bfe5-0a9ee258ac12 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:50.271433 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-bdb0e039-8df5-40f9-bfe5-0a9ee258ac12 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:50.279760 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bdb0e039-8df5-40f9-bfe5-0a9ee258ac12 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:50.284925 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bdb0e039-8df5-40f9-bfe5-0a9ee258ac12 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:50.286056 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bdb0e039-8df5-40f9-bfe5-0a9ee258ac12 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:50.286621 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bdb0e039-8df5-40f9-bfe5-0a9ee258ac12 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:50.518124 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-bdb0e039-8df5-40f9-bfe5-0a9ee258ac12 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:50.527001 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-bdb0e039-8df5-40f9-bfe5-0a9ee258ac12 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.260262 Dec 27 14:22:50.527925 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 151/276] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:50 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:50.901143 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-34f4a93d-80fa-47da-9e4e-d65ab67c534b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'create', calling method: .version_select at 0x7f8028686040>, body: {"keypair": {"name": "tempest-keypair-718376350"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:50.926496 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-34f4a93d-80fa-47da-9e4e-d65ab67c534b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Getting quotas for project cb5e638b0aa0424484c3eb48434d7e66. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:22:50.931751 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-34f4a93d-80fa-47da-9e4e-d65ab67c534b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Getting quotas for user 1cfb17ae7cd742e191aa3d456e4346d0 and project cb5e638b0aa0424484c3eb48434d7e66. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:22:51.153891 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-34f4a93d-80fa-47da-9e4e-d65ab67c534b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Getting quotas for project cb5e638b0aa0424484c3eb48434d7e66. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:22:51.158353 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-34f4a93d-80fa-47da-9e4e-d65ab67c534b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Getting quotas for user 1cfb17ae7cd742e191aa3d456e4346d0 and project cb5e638b0aa0424484c3eb48434d7e66. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:22:51.188449 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-34f4a93d-80fa-47da-9e4e-d65ab67c534b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.584452 Dec 27 14:22:51.197485 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 152/277] 10.222.0.37 () {62 vars in 1198 bytes} [Mon Dec 27 14:22:50 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 596 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Dec 27 14:22:51.203767 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-823d8dbd-bcd0-4d59-ba03-3f994b54c558 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:51.204424 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-823d8dbd-bcd0-4d59-ba03-3f994b54c558 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:51.222594 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-823d8dbd-bcd0-4d59-ba03-3f994b54c558 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:51.223051 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-823d8dbd-bcd0-4d59-ba03-3f994b54c558 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:51.223869 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-823d8dbd-bcd0-4d59-ba03-3f994b54c558 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:51.224330 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-823d8dbd-bcd0-4d59-ba03-3f994b54c558 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:51.595756 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-823d8dbd-bcd0-4d59-ba03-3f994b54c558 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:51.607489 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-823d8dbd-bcd0-4d59-ba03-3f994b54c558 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1358 microversion: 2.1 time: 0.406103 Dec 27 14:22:51.608906 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 153/278] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:51 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1358 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:51.623703 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ef13ff21-8db5-4632-aa97-694b9cdff1df tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:51.624643 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ef13ff21-8db5-4632-aa97-694b9cdff1df tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:51.637991 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ef13ff21-8db5-4632-aa97-694b9cdff1df tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:51.640616 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ef13ff21-8db5-4632-aa97-694b9cdff1df tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:51.642869 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ef13ff21-8db5-4632-aa97-694b9cdff1df tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:51.643568 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ef13ff21-8db5-4632-aa97-694b9cdff1df tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:51.845790 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ef13ff21-8db5-4632-aa97-694b9cdff1df tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:51.857215 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ef13ff21-8db5-4632-aa97-694b9cdff1df tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.244562 Dec 27 14:22:51.858193 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 154/279] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:51 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:51.872099 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1837d785-79a4-41d7-b2b8-2869c47e6ee2 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:51.873288 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1837d785-79a4-41d7-b2b8-2869c47e6ee2 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:51.892671 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1837d785-79a4-41d7-b2b8-2869c47e6ee2 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:51.893328 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1837d785-79a4-41d7-b2b8-2869c47e6ee2 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:51.894229 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1837d785-79a4-41d7-b2b8-2869c47e6ee2 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:51.894738 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1837d785-79a4-41d7-b2b8-2869c47e6ee2 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:52.208096 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1837d785-79a4-41d7-b2b8-2869c47e6ee2 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:52.226564 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1837d785-79a4-41d7-b2b8-2869c47e6ee2 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.366454 Dec 27 14:22:52.227290 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 155/280] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:51 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:52.626196 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-57978b12-7033-4ac8-a114-2eb3a2ecd55b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:52.627669 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-57978b12-7033-4ac8-a114-2eb3a2ecd55b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:52.639520 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-57978b12-7033-4ac8-a114-2eb3a2ecd55b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:52.649963 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-57978b12-7033-4ac8-a114-2eb3a2ecd55b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:52.651185 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-57978b12-7033-4ac8-a114-2eb3a2ecd55b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:52.652127 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-57978b12-7033-4ac8-a114-2eb3a2ecd55b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:52.960140 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-57978b12-7033-4ac8-a114-2eb3a2ecd55b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:52.974010 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-57978b12-7033-4ac8-a114-2eb3a2ecd55b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1358 microversion: 2.1 time: 0.350072 Dec 27 14:22:52.979358 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 156/281] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:52 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1358 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:52.985305 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7778b247-5202-49be-8423-96e56537bf12 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:52.986739 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7778b247-5202-49be-8423-96e56537bf12 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:52.996573 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7778b247-5202-49be-8423-96e56537bf12 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:52.997349 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7778b247-5202-49be-8423-96e56537bf12 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:52.998401 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7778b247-5202-49be-8423-96e56537bf12 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:52.999374 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7778b247-5202-49be-8423-96e56537bf12 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:53.239757 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-7778b247-5202-49be-8423-96e56537bf12 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:53.263425 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7778b247-5202-49be-8423-96e56537bf12 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.282665 Dec 27 14:22:53.269313 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 157/282] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:52 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:53.277064 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b3b3d6e9-0bdb-4c5a-ab7f-82b74143b481 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:53.286040 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b3b3d6e9-0bdb-4c5a-ab7f-82b74143b481 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:53.299520 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b3b3d6e9-0bdb-4c5a-ab7f-82b74143b481 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:53.305313 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b3b3d6e9-0bdb-4c5a-ab7f-82b74143b481 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:53.306540 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b3b3d6e9-0bdb-4c5a-ab7f-82b74143b481 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:53.311712 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b3b3d6e9-0bdb-4c5a-ab7f-82b74143b481 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:53.609135 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b3b3d6e9-0bdb-4c5a-ab7f-82b74143b481 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:53.618942 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b3b3d6e9-0bdb-4c5a-ab7f-82b74143b481 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.346794 Dec 27 14:22:53.619537 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 158/283] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:53 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:53.865022 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a3d39383-5a62-431f-8d9c-e4805daf87de tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-108433124", "imageRef": "c8bd383f-96c5-4e2b-aaa5-fabd68b307f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d685d204-a878-46a9-9c80-314fd33c30a4"}], "security_groups": [{"name": "tempest-securitygroup--1880734074"}], "key_name": "tempest-keypair-718376350", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:54.015164 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.network.neutron [None req-a3d39383-5a62-431f-8d9c-e4805daf87de tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] validate_networks() for [('d685d204-a878-46a9-9c80-314fd33c30a4', None, None, None, None, None)] {{(pid=116105) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 27 14:22:54.516519 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-a3d39383-5a62-431f-8d9c-e4805daf87de tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Flavor limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 27 14:22:54.517130 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-a3d39383-5a62-431f-8d9c-e4805daf87de tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Image limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 27 14:22:54.517757 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-a3d39383-5a62-431f-8d9c-e4805daf87de tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Flavor pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 27 14:22:54.518348 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-a3d39383-5a62-431f-8d9c-e4805daf87de tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Image pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 27 14:22:54.518928 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-a3d39383-5a62-431f-8d9c-e4805daf87de tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 27 14:22:54.527941 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a3d39383-5a62-431f-8d9c-e4805daf87de tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:54.528398 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a3d39383-5a62-431f-8d9c-e4805daf87de tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:54.529214 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a3d39383-5a62-431f-8d9c-e4805daf87de tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:54.529837 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a3d39383-5a62-431f-8d9c-e4805daf87de tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:54.547627 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-a3d39383-5a62-431f-8d9c-e4805daf87de tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Getting quotas for project cb5e638b0aa0424484c3eb48434d7e66. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:22:54.552127 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-a3d39383-5a62-431f-8d9c-e4805daf87de tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Getting quotas for user 1cfb17ae7cd742e191aa3d456e4346d0 and project cb5e638b0aa0424484c3eb48434d7e66. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:22:54.564799 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a3d39383-5a62-431f-8d9c-e4805daf87de tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Going to run 1 instances... {{(pid=116105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 27 14:22:54.567464 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a3d39383-5a62-431f-8d9c-e4805daf87de tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c8bd383f-96c5-4e2b-aaa5-fabd68b307f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 27 14:22:54.617045 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a3d39383-5a62-431f-8d9c-e4805daf87de tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.756200 Dec 27 14:22:54.618335 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 159/284] 10.222.0.37 () {62 vars in 1187 bytes} [Mon Dec 27 14:22:53 2021] POST /compute/v2.1/servers => generated 402 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 27 14:22:54.623774 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ac58f74e-f307-4a76-9be5-0122f170e32f tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:54.624629 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ac58f74e-f307-4a76-9be5-0122f170e32f tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:54.632003 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac58f74e-f307-4a76-9be5-0122f170e32f tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:54.632905 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac58f74e-f307-4a76-9be5-0122f170e32f tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:54.633869 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac58f74e-f307-4a76-9be5-0122f170e32f tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:54.634465 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac58f74e-f307-4a76-9be5-0122f170e32f tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:54.833876 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ac58f74e-f307-4a76-9be5-0122f170e32f tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:54.842080 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ac58f74e-f307-4a76-9be5-0122f170e32f tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1358 microversion: 2.1 time: 0.222148 Dec 27 14:22:54.843499 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 160/285] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:54 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1358 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:54.847994 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-70dbc9cb-d06e-461b-8a6e-723265d4edb1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:54.848816 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-70dbc9cb-d06e-461b-8a6e-723265d4edb1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:54.856769 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-70dbc9cb-d06e-461b-8a6e-723265d4edb1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:54.857225 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-70dbc9cb-d06e-461b-8a6e-723265d4edb1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:54.858023 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-70dbc9cb-d06e-461b-8a6e-723265d4edb1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:54.858460 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-70dbc9cb-d06e-461b-8a6e-723265d4edb1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:55.037693 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-70dbc9cb-d06e-461b-8a6e-723265d4edb1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:55.048561 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-70dbc9cb-d06e-461b-8a6e-723265d4edb1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.203294 Dec 27 14:22:55.049443 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 161/286] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:54 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:55.063275 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-870bcc5f-1f58-454a-8220-1276c0fd20c6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:55.064415 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-870bcc5f-1f58-454a-8220-1276c0fd20c6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:55.123227 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-870bcc5f-1f58-454a-8220-1276c0fd20c6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:55.136681 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-870bcc5f-1f58-454a-8220-1276c0fd20c6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:55.139132 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-870bcc5f-1f58-454a-8220-1276c0fd20c6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:55.140157 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-870bcc5f-1f58-454a-8220-1276c0fd20c6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1280 microversion: 2.20 time: 0.089078 Dec 27 14:22:55.140750 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 162/287] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:22:55 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:22:55.144944 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5789af51-69ce-4c4a-84e1-b91cd4bb4c2c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:55.145547 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5789af51-69ce-4c4a-84e1-b91cd4bb4c2c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:55.152385 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5789af51-69ce-4c4a-84e1-b91cd4bb4c2c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:55.152842 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5789af51-69ce-4c4a-84e1-b91cd4bb4c2c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:55.153637 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5789af51-69ce-4c4a-84e1-b91cd4bb4c2c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:55.154074 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5789af51-69ce-4c4a-84e1-b91cd4bb4c2c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:55.302287 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5789af51-69ce-4c4a-84e1-b91cd4bb4c2c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:55.310393 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5789af51-69ce-4c4a-84e1-b91cd4bb4c2c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.168642 Dec 27 14:22:55.311010 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 163/288] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:55 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:55.862729 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-57368db7-ba69-4ee5-a2bf-b533bce6b335 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:55.863910 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-57368db7-ba69-4ee5-a2bf-b533bce6b335 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:55.893065 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-57368db7-ba69-4ee5-a2bf-b533bce6b335 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:55.893714 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-57368db7-ba69-4ee5-a2bf-b533bce6b335 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:55.894805 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-57368db7-ba69-4ee5-a2bf-b533bce6b335 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:55.895494 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-57368db7-ba69-4ee5-a2bf-b533bce6b335 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:56.041320 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-57368db7-ba69-4ee5-a2bf-b533bce6b335 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:56.049097 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-57368db7-ba69-4ee5-a2bf-b533bce6b335 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1358 microversion: 2.1 time: 0.190769 Dec 27 14:22:56.049659 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 164/289] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:55 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:56.065327 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ad5fa28b-f95e-4177-b730-54fba8e6e9ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:56.065928 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ad5fa28b-f95e-4177-b730-54fba8e6e9ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:56.072941 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ad5fa28b-f95e-4177-b730-54fba8e6e9ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:56.073394 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ad5fa28b-f95e-4177-b730-54fba8e6e9ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:56.074190 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ad5fa28b-f95e-4177-b730-54fba8e6e9ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:56.074630 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ad5fa28b-f95e-4177-b730-54fba8e6e9ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:56.230911 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ad5fa28b-f95e-4177-b730-54fba8e6e9ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:56.243479 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ad5fa28b-f95e-4177-b730-54fba8e6e9ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.181700 Dec 27 14:22:56.244483 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 165/290] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:56 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:56.250086 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-89690ef1-3e80-41f7-b6f0-7d8ba78606a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:56.250742 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-89690ef1-3e80-41f7-b6f0-7d8ba78606a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:56.257633 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-89690ef1-3e80-41f7-b6f0-7d8ba78606a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:56.257836 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-89690ef1-3e80-41f7-b6f0-7d8ba78606a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:56.258640 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-89690ef1-3e80-41f7-b6f0-7d8ba78606a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:56.259131 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-89690ef1-3e80-41f7-b6f0-7d8ba78606a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:56.325857 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-89690ef1-3e80-41f7-b6f0-7d8ba78606a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:56.336183 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-89690ef1-3e80-41f7-b6f0-7d8ba78606a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:56.337856 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-89690ef1-3e80-41f7-b6f0-7d8ba78606a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:56.339139 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-89690ef1-3e80-41f7-b6f0-7d8ba78606a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1284 microversion: 2.20 time: 0.093587 Dec 27 14:22:56.339799 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 166/291] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:22:56 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:22:56.353051 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a24151b4-fd4b-43bd-b731-6cffd980c4d0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:56.353669 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a24151b4-fd4b-43bd-b731-6cffd980c4d0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:56.359645 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a24151b4-fd4b-43bd-b731-6cffd980c4d0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:56.360134 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a24151b4-fd4b-43bd-b731-6cffd980c4d0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:56.360928 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a24151b4-fd4b-43bd-b731-6cffd980c4d0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:56.361423 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a24151b4-fd4b-43bd-b731-6cffd980c4d0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:56.509186 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a24151b4-fd4b-43bd-b731-6cffd980c4d0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:56.518038 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a24151b4-fd4b-43bd-b731-6cffd980c4d0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.177080 Dec 27 14:22:56.519101 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 167/292] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:56 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:57.066664 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-673f1d9a-aaf5-4a69-9954-903b426cc164 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:57.067285 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-673f1d9a-aaf5-4a69-9954-903b426cc164 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:57.073705 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-673f1d9a-aaf5-4a69-9954-903b426cc164 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:57.074157 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-673f1d9a-aaf5-4a69-9954-903b426cc164 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:57.074948 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-673f1d9a-aaf5-4a69-9954-903b426cc164 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:57.075378 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-673f1d9a-aaf5-4a69-9954-903b426cc164 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:57.209374 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-673f1d9a-aaf5-4a69-9954-903b426cc164 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:57.217264 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-673f1d9a-aaf5-4a69-9954-903b426cc164 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1358 microversion: 2.1 time: 0.154351 Dec 27 14:22:57.217827 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 168/293] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:57 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:57.259996 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a06ac68c-a8bc-4e81-aada-aaaf4d763e3b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:57.260596 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a06ac68c-a8bc-4e81-aada-aaaf4d763e3b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:57.266323 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a06ac68c-a8bc-4e81-aada-aaaf4d763e3b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:57.266775 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a06ac68c-a8bc-4e81-aada-aaaf4d763e3b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:57.267557 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a06ac68c-a8bc-4e81-aada-aaaf4d763e3b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:57.268031 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a06ac68c-a8bc-4e81-aada-aaaf4d763e3b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:57.394899 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a06ac68c-a8bc-4e81-aada-aaaf4d763e3b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:57.402331 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a06ac68c-a8bc-4e81-aada-aaaf4d763e3b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.146334 Dec 27 14:22:57.402931 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 169/294] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:57 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:57.407312 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4306e29d-6d46-490d-81b3-0450df19b8b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:57.407931 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4306e29d-6d46-490d-81b3-0450df19b8b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:57.413269 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4306e29d-6d46-490d-81b3-0450df19b8b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:57.413715 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4306e29d-6d46-490d-81b3-0450df19b8b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:57.414483 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4306e29d-6d46-490d-81b3-0450df19b8b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:57.415414 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4306e29d-6d46-490d-81b3-0450df19b8b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:57.472806 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4306e29d-6d46-490d-81b3-0450df19b8b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:57.481357 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4306e29d-6d46-490d-81b3-0450df19b8b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:57.482848 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4306e29d-6d46-490d-81b3-0450df19b8b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:57.483984 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4306e29d-6d46-490d-81b3-0450df19b8b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1284 microversion: 2.20 time: 0.080113 Dec 27 14:22:57.484540 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 170/295] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:22:57 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1284 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:22:57.536366 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0167ec10-a823-4682-b8c5-af7decf8e09c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:57.536995 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0167ec10-a823-4682-b8c5-af7decf8e09c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:57.543393 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0167ec10-a823-4682-b8c5-af7decf8e09c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:57.543853 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0167ec10-a823-4682-b8c5-af7decf8e09c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:57.544625 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0167ec10-a823-4682-b8c5-af7decf8e09c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:57.545056 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0167ec10-a823-4682-b8c5-af7decf8e09c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:57.679359 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0167ec10-a823-4682-b8c5-af7decf8e09c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:57.687428 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0167ec10-a823-4682-b8c5-af7decf8e09c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.154418 Dec 27 14:22:57.688018 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 171/296] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:57 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:22:58.074310 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-cca5eb13-ec0f-49f5-9444-25ff75d45ad2 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2083693051", "imageRef": "c8bd383f-96c5-4e2b-aaa5-fabd68b307f6", "flavorRef": "452"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:58.122989 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.network.neutron [None req-cca5eb13-ec0f-49f5-9444-25ff75d45ad2 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] validate_networks() for None {{(pid=116105) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 27 14:22:58.547373 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-03e760bb-4ce6-4815-a068-4aa59d4508dd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28143 microversion: 2.1 time: 17.784043 Dec 27 14:22:58.551426 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 126/297] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:22:40 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28143 bytes in 17786 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:22:58.554960 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-860ac98b-3b44-47e3-a842-dd22154c1357 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:58.555684 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-860ac98b-3b44-47e3-a842-dd22154c1357 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:58.575918 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-860ac98b-3b44-47e3-a842-dd22154c1357 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:58.576368 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-860ac98b-3b44-47e3-a842-dd22154c1357 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:58.577460 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-860ac98b-3b44-47e3-a842-dd22154c1357 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:58.578058 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-860ac98b-3b44-47e3-a842-dd22154c1357 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:58.624134 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-cca5eb13-ec0f-49f5-9444-25ff75d45ad2 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Flavor limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 27 14:22:58.624620 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-cca5eb13-ec0f-49f5-9444-25ff75d45ad2 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Image limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 27 14:22:58.625276 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-cca5eb13-ec0f-49f5-9444-25ff75d45ad2 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Flavor pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 27 14:22:58.625687 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-cca5eb13-ec0f-49f5-9444-25ff75d45ad2 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Image pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 27 14:22:58.626100 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-cca5eb13-ec0f-49f5-9444-25ff75d45ad2 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 27 14:22:58.636819 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cca5eb13-ec0f-49f5-9444-25ff75d45ad2 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:58.637274 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cca5eb13-ec0f-49f5-9444-25ff75d45ad2 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:58.638095 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cca5eb13-ec0f-49f5-9444-25ff75d45ad2 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:58.638532 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cca5eb13-ec0f-49f5-9444-25ff75d45ad2 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:58.659644 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-cca5eb13-ec0f-49f5-9444-25ff75d45ad2 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Getting quotas for project ca740df033cb4ee7a6a42fe098749e01. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:22:58.663997 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-cca5eb13-ec0f-49f5-9444-25ff75d45ad2 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Getting quotas for user 68c343e960fb4bbe8dda23a8c338c2eb and project ca740df033cb4ee7a6a42fe098749e01. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:22:58.676105 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-cca5eb13-ec0f-49f5-9444-25ff75d45ad2 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Going to run 1 instances... {{(pid=116105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 27 14:22:58.678311 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-cca5eb13-ec0f-49f5-9444-25ff75d45ad2 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] [instance: e8d4102a-6cfc-442e-aa11-c1af898bfedd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c8bd383f-96c5-4e2b-aaa5-fabd68b307f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 27 14:22:58.729448 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-860ac98b-3b44-47e3-a842-dd22154c1357 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:58.742351 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-860ac98b-3b44-47e3-a842-dd22154c1357 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1358 microversion: 2.1 time: 0.190638 Dec 27 14:22:58.743304 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 127/298] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:58 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:58.750993 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-cca5eb13-ec0f-49f5-9444-25ff75d45ad2 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680812 Dec 27 14:22:58.756764 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 172/299] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Dec 27 14:22:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 27 14:22:58.762617 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1369f0dd-3657-429a-9fae-1c331c29da88 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:58.764992 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1369f0dd-3657-429a-9fae-1c331c29da88 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:58.765461 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-969630fb-31f0-4f8f-b8de-a00c76db3d3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:58.766241 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-969630fb-31f0-4f8f-b8de-a00c76db3d3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:58.773619 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-969630fb-31f0-4f8f-b8de-a00c76db3d3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:58.774075 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-969630fb-31f0-4f8f-b8de-a00c76db3d3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:58.774921 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-969630fb-31f0-4f8f-b8de-a00c76db3d3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:58.775394 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-969630fb-31f0-4f8f-b8de-a00c76db3d3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:58.785736 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1369f0dd-3657-429a-9fae-1c331c29da88 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:58.787713 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1369f0dd-3657-429a-9fae-1c331c29da88 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:58.791726 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1369f0dd-3657-429a-9fae-1c331c29da88 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:58.794489 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1369f0dd-3657-429a-9fae-1c331c29da88 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:58.858165 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-969630fb-31f0-4f8f-b8de-a00c76db3d3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:58.889834 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-969630fb-31f0-4f8f-b8de-a00c76db3d3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:58.894002 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-969630fb-31f0-4f8f-b8de-a00c76db3d3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:58.898177 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-969630fb-31f0-4f8f-b8de-a00c76db3d3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1276 microversion: 2.20 time: 0.140203 Dec 27 14:22:58.899028 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 173/300] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:22:58 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:22:58.914324 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9c761f72-4faf-4aaa-a6c8-54ef4d343637 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:58.915119 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9c761f72-4faf-4aaa-a6c8-54ef4d343637 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:58.925551 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9c761f72-4faf-4aaa-a6c8-54ef4d343637 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:58.926568 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9c761f72-4faf-4aaa-a6c8-54ef4d343637 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:58.929842 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9c761f72-4faf-4aaa-a6c8-54ef4d343637 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:58.934084 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9c761f72-4faf-4aaa-a6c8-54ef4d343637 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:59.050075 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1369f0dd-3657-429a-9fae-1c331c29da88 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:59.060741 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1369f0dd-3657-429a-9fae-1c331c29da88 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.315919 Dec 27 14:22:59.061991 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 128/301] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:58 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:59.069118 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3bb06249-83f9-453a-ad28-62d9db9c3c89 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:59.069994 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3bb06249-83f9-453a-ad28-62d9db9c3c89 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] [instance: e8d4102a-6cfc-442e-aa11-c1af898bfedd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:59.167118 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3bb06249-83f9-453a-ad28-62d9db9c3c89 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c343e960fb4bbe8dda23a8c338c2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca740df033cb4ee7a6a42fe098749e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:59.174981 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3bb06249-83f9-453a-ad28-62d9db9c3c89 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] 10.222.0.37 "GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd" status: 200 len: 1215 microversion: 2.1 time: 0.110393 Dec 27 14:22:59.187780 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 129/302] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:59 2021] GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd => generated 1215 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:59.220467 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9c761f72-4faf-4aaa-a6c8-54ef4d343637 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:22:59.231397 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9c761f72-4faf-4aaa-a6c8-54ef4d343637 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1318 microversion: 2.1 time: 0.321792 Dec 27 14:22:59.234268 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 174/303] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:58 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:22:59.559329 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bb19da30-c80e-4a58-bc65-6698d44c2391 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:22:59.560420 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bb19da30-c80e-4a58-bc65-6698d44c2391 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:59.568200 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb19da30-c80e-4a58-bc65-6698d44c2391 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:59.568730 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb19da30-c80e-4a58-bc65-6698d44c2391 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:59.569622 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb19da30-c80e-4a58-bc65-6698d44c2391 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:59.570313 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bb19da30-c80e-4a58-bc65-6698d44c2391 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:59.690017 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bb19da30-c80e-4a58-bc65-6698d44c2391 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28143 microversion: 2.1 time: 0.133674 Dec 27 14:22:59.691069 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 130/304] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:22:59 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28143 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:22:59.760883 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d3a81413-a8dd-453b-8e86-d753cc19f6f8 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:59.761634 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d3a81413-a8dd-453b-8e86-d753cc19f6f8 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:59.768734 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d3a81413-a8dd-453b-8e86-d753cc19f6f8 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:59.769186 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d3a81413-a8dd-453b-8e86-d753cc19f6f8 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:59.769980 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d3a81413-a8dd-453b-8e86-d753cc19f6f8 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:59.770406 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d3a81413-a8dd-453b-8e86-d753cc19f6f8 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:59.926281 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ebabee61-d6b7-469c-821f-b393a53a64d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:22:59.927143 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ebabee61-d6b7-469c-821f-b393a53a64d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:22:59.936981 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ebabee61-d6b7-469c-821f-b393a53a64d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:59.938029 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ebabee61-d6b7-469c-821f-b393a53a64d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:22:59.939250 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ebabee61-d6b7-469c-821f-b393a53a64d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:22:59.939774 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ebabee61-d6b7-469c-821f-b393a53a64d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:00.007498 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d3a81413-a8dd-453b-8e86-d753cc19f6f8 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:00.016319 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d3a81413-a8dd-453b-8e86-d753cc19f6f8 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1358 microversion: 2.1 time: 0.260363 Dec 27 14:23:00.017448 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ebabee61-d6b7-469c-821f-b393a53a64d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:00.027476 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 175/305] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:22:59 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1358 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:00.032490 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ebabee61-d6b7-469c-821f-b393a53a64d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:00.034339 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ebabee61-d6b7-469c-821f-b393a53a64d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:00.035446 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ebabee61-d6b7-469c-821f-b393a53a64d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1338 microversion: 2.20 time: 0.117340 Dec 27 14:23:00.036017 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 131/306] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:22:59 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1338 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:23:00.078672 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f0779b0d-105d-4de6-b374-f6a2cee926b9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:00.079282 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f0779b0d-105d-4de6-b374-f6a2cee926b9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:00.085679 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f0779b0d-105d-4de6-b374-f6a2cee926b9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:00.086128 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f0779b0d-105d-4de6-b374-f6a2cee926b9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:00.087335 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f0779b0d-105d-4de6-b374-f6a2cee926b9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:00.087794 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f0779b0d-105d-4de6-b374-f6a2cee926b9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:00.194505 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4f206acc-d800-4024-b0f9-78614fbb675a tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:00.195470 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4f206acc-d800-4024-b0f9-78614fbb675a tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] [instance: e8d4102a-6cfc-442e-aa11-c1af898bfedd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:00.203821 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4f206acc-d800-4024-b0f9-78614fbb675a tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:00.204812 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4f206acc-d800-4024-b0f9-78614fbb675a tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:00.206262 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4f206acc-d800-4024-b0f9-78614fbb675a tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:00.206791 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4f206acc-d800-4024-b0f9-78614fbb675a tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:00.326731 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f0779b0d-105d-4de6-b374-f6a2cee926b9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:00.343092 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f0779b0d-105d-4de6-b374-f6a2cee926b9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.266752 Dec 27 14:23:00.343768 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 176/307] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:00 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:00.356220 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-78f88230-6cf7-49a6-8514-e135fbeeebaa tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:00.357260 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-78f88230-6cf7-49a6-8514-e135fbeeebaa tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:00.364557 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-78f88230-6cf7-49a6-8514-e135fbeeebaa tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:00.365081 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-78f88230-6cf7-49a6-8514-e135fbeeebaa tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:00.371698 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4f206acc-d800-4024-b0f9-78614fbb675a tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c343e960fb4bbe8dda23a8c338c2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca740df033cb4ee7a6a42fe098749e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:00.379537 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-78f88230-6cf7-49a6-8514-e135fbeeebaa tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:00.380139 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4f206acc-d800-4024-b0f9-78614fbb675a tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] 10.222.0.37 "GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd" status: 200 len: 1275 microversion: 2.1 time: 0.188676 Dec 27 14:23:00.380821 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-78f88230-6cf7-49a6-8514-e135fbeeebaa tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:00.382596 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 132/308] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:00 2021] GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd => generated 1275 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:00.638002 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-78f88230-6cf7-49a6-8514-e135fbeeebaa tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:00.646551 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-78f88230-6cf7-49a6-8514-e135fbeeebaa tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1509 microversion: 2.1 time: 0.299824 Dec 27 14:23:00.647235 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 177/309] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:00 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1509 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:00.663656 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d9371d68-4c1c-4796-a081-e7312ae74688 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "202161ff-aad4-4534-87f8-84fd052bfbff"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:00.665416 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d9371d68-4c1c-4796-a081-e7312ae74688 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:00.683158 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d9371d68-4c1c-4796-a081-e7312ae74688 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:00.685545 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d9371d68-4c1c-4796-a081-e7312ae74688 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:00.687777 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d9371d68-4c1c-4796-a081-e7312ae74688 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:00.688483 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d9371d68-4c1c-4796-a081-e7312ae74688 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:00.704387 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4592712c-ef71-4657-970c-437e23217d88 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:00.705973 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4592712c-ef71-4657-970c-437e23217d88 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:00.723897 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4592712c-ef71-4657-970c-437e23217d88 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:00.729069 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4592712c-ef71-4657-970c-437e23217d88 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:00.730504 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4592712c-ef71-4657-970c-437e23217d88 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:00.737994 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4592712c-ef71-4657-970c-437e23217d88 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:00.856214 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-d9371d68-4c1c-4796-a081-e7312ae74688 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] HTTP exception thrown: Invalid volume: volume 202161ff-aad4-4534-87f8-84fd052bfbff is already attached to instances: 9183a2b5-fbe1-45df-906b-e7311f3a3826 Dec 27 14:23:00.857472 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d9371d68-4c1c-4796-a081-e7312ae74688 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Returning 400 to user: Invalid volume: volume 202161ff-aad4-4534-87f8-84fd052bfbff is already attached to instances: 9183a2b5-fbe1-45df-906b-e7311f3a3826 {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:23:00.858574 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d9371d68-4c1c-4796-a081-e7312ae74688 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "POST /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.198825 Dec 27 14:23:00.859692 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 133/310] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Dec 27 14:23:00 2021] POST /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45/os-volume_attachments => generated 174 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 27 14:23:00.914322 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4592712c-ef71-4657-970c-437e23217d88 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28143 microversion: 2.1 time: 0.215234 Dec 27 14:23:00.915624 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 178/311] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:00 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28143 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:23:00.969234 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-13a4fe7a-6f2d-4ff4-93df-5d61fef28320 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:00.969724 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-13a4fe7a-6f2d-4ff4-93df-5d61fef28320 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:00.988969 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13a4fe7a-6f2d-4ff4-93df-5d61fef28320 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:00.989754 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13a4fe7a-6f2d-4ff4-93df-5d61fef28320 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:00.992154 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13a4fe7a-6f2d-4ff4-93df-5d61fef28320 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:00.993927 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13a4fe7a-6f2d-4ff4-93df-5d61fef28320 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:01.033870 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-20188b5e-b27b-4021-a0a5-567317655612 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:01.035021 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-20188b5e-b27b-4021-a0a5-567317655612 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:01.049449 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20188b5e-b27b-4021-a0a5-567317655612 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:01.050164 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20188b5e-b27b-4021-a0a5-567317655612 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:01.052322 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20188b5e-b27b-4021-a0a5-567317655612 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:01.053280 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20188b5e-b27b-4021-a0a5-567317655612 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:01.245671 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-13a4fe7a-6f2d-4ff4-93df-5d61fef28320 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lazy-loading 'services' on Instance uuid 9183a2b5-fbe1-45df-906b-e7311f3a3826 {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:23:01.460483 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-20188b5e-b27b-4021-a0a5-567317655612 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:01.472854 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-20188b5e-b27b-4021-a0a5-567317655612 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1358 microversion: 2.1 time: 0.443508 Dec 27 14:23:01.485840 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 179/312] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:01 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1358 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:01.492442 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e1661e73-a41e-4784-a1e7-7d23b90d14fe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:01.493280 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e1661e73-a41e-4784-a1e7-7d23b90d14fe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:01.500707 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e1661e73-a41e-4784-a1e7-7d23b90d14fe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:01.501368 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e1661e73-a41e-4784-a1e7-7d23b90d14fe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:01.502508 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e1661e73-a41e-4784-a1e7-7d23b90d14fe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:01.503107 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e1661e73-a41e-4784-a1e7-7d23b90d14fe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:01.504086 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-13a4fe7a-6f2d-4ff4-93df-5d61fef28320 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "DELETE /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826/os-volume_attachments/202161ff-aad4-4534-87f8-84fd052bfbff" status: 202 len: 0 microversion: 2.1 time: 0.544645 Dec 27 14:23:01.504880 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 134/313] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Dec 27 14:23:00 2021] DELETE /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826/os-volume_attachments/202161ff-aad4-4534-87f8-84fd052bfbff => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:23:01.525550 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4ec7bb07-30c8-40b0-9141-2694e859461a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:01.526891 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4ec7bb07-30c8-40b0-9141-2694e859461a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:01.535923 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ec7bb07-30c8-40b0-9141-2694e859461a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:01.536856 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ec7bb07-30c8-40b0-9141-2694e859461a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:01.539768 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ec7bb07-30c8-40b0-9141-2694e859461a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:01.541367 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ec7bb07-30c8-40b0-9141-2694e859461a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:02.062272 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e1661e73-a41e-4784-a1e7-7d23b90d14fe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:02.070269 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e1661e73-a41e-4784-a1e7-7d23b90d14fe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:02.072252 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e1661e73-a41e-4784-a1e7-7d23b90d14fe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:02.074319 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e1661e73-a41e-4784-a1e7-7d23b90d14fe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1406 microversion: 2.20 time: 0.587481 Dec 27 14:23:02.075098 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 180/314] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:23:01 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1406 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:23:02.079637 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8f3c45ca-d110-45f5-a329-2f41ab1a683c tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:02.080528 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8f3c45ca-d110-45f5-a329-2f41ab1a683c tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] [instance: e8d4102a-6cfc-442e-aa11-c1af898bfedd] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:02.082031 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4ec7bb07-30c8-40b0-9141-2694e859461a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:02.087524 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f3c45ca-d110-45f5-a329-2f41ab1a683c tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:02.088010 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f3c45ca-d110-45f5-a329-2f41ab1a683c tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:02.089186 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f3c45ca-d110-45f5-a329-2f41ab1a683c tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:02.089840 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f3c45ca-d110-45f5-a329-2f41ab1a683c tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:02.091775 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4ec7bb07-30c8-40b0-9141-2694e859461a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.581557 Dec 27 14:23:02.092604 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 135/315] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:01 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:02.101253 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2fb8a366-68a2-4225-8f22-02f0fd010ce8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:02.102999 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2fb8a366-68a2-4225-8f22-02f0fd010ce8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:02.110744 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2fb8a366-68a2-4225-8f22-02f0fd010ce8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:02.111192 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2fb8a366-68a2-4225-8f22-02f0fd010ce8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:02.112073 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2fb8a366-68a2-4225-8f22-02f0fd010ce8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:02.112512 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2fb8a366-68a2-4225-8f22-02f0fd010ce8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:02.163130 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2fb8a366-68a2-4225-8f22-02f0fd010ce8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069595 Dec 27 14:23:02.166076 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 136/316] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:23:02 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:23:02.191097 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-6a8896a3-c6d8-404b-b332-fec9f81bd558 req-e2906593-1d23-4cd6-9689-568680fe1238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aad07b94-d83b-4d44-856c-80ac2e24b8b4", "tag": "d8953eb3-d364-4473-98c5-e33562dcd960"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:02.194632 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:23:02.194632 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:23:02.204625 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-6a8896a3-c6d8-404b-b332-fec9f81bd558 req-e2906593-1d23-4cd6-9689-568680fe1238 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:02.205393 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-6a8896a3-c6d8-404b-b332-fec9f81bd558 req-e2906593-1d23-4cd6-9689-568680fe1238 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:02.219276 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-6a8896a3-c6d8-404b-b332-fec9f81bd558 req-e2906593-1d23-4cd6-9689-568680fe1238 service nova] Creating event network-changed:d8953eb3-d364-4473-98c5-e33562dcd960 for instance aad07b94-d83b-4d44-856c-80ac2e24b8b4 on hv-cinder-82301 Dec 27 14:23:02.224119 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-6a8896a3-c6d8-404b-b332-fec9f81bd558 req-e2906593-1d23-4cd6-9689-568680fe1238 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052818 Dec 27 14:23:02.225067 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 137/317] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:23:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:23:02.231996 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-38646f95-337b-41d4-80eb-7e4b35fdf50a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:02.233326 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-38646f95-337b-41d4-80eb-7e4b35fdf50a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:02.242269 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38646f95-337b-41d4-80eb-7e4b35fdf50a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:02.243039 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38646f95-337b-41d4-80eb-7e4b35fdf50a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:02.244597 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38646f95-337b-41d4-80eb-7e4b35fdf50a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:02.257451 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-38646f95-337b-41d4-80eb-7e4b35fdf50a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:02.345605 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-38646f95-337b-41d4-80eb-7e4b35fdf50a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28143 microversion: 2.1 time: 0.115776 Dec 27 14:23:02.346275 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 138/318] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:02 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28143 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:02.477220 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8f3c45ca-d110-45f5-a329-2f41ab1a683c tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c343e960fb4bbe8dda23a8c338c2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca740df033cb4ee7a6a42fe098749e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:02.495823 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-025600f7-c503-46bc-aa75-add077844e6c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:02.496641 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-025600f7-c503-46bc-aa75-add077844e6c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:02.498609 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8f3c45ca-d110-45f5-a329-2f41ab1a683c tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] 10.222.0.37 "GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd" status: 200 len: 1315 microversion: 2.1 time: 0.422272 Dec 27 14:23:02.499196 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 181/319] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:02 2021] GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:02.518592 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-025600f7-c503-46bc-aa75-add077844e6c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:02.519607 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-025600f7-c503-46bc-aa75-add077844e6c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:02.520565 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-025600f7-c503-46bc-aa75-add077844e6c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:02.521202 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-025600f7-c503-46bc-aa75-add077844e6c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:02.853383 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-025600f7-c503-46bc-aa75-add077844e6c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:02.867718 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-025600f7-c503-46bc-aa75-add077844e6c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1358 microversion: 2.1 time: 0.379049 Dec 27 14:23:02.878462 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 139/320] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:02 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1358 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:02.958147 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-10150a9f-2915-48c3-ae68-08274d208ef5 req-8106d2ee-a5c6-45b4-bed3-0e2130fd03c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8d4102a-6cfc-442e-aa11-c1af898bfedd", "tag": "93ed3518-1780-484d-ba95-946cdfd9103a"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:02.961042 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:23:02.961042 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:23:02.999171 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-10150a9f-2915-48c3-ae68-08274d208ef5 req-8106d2ee-a5c6-45b4-bed3-0e2130fd03c3 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:03.000018 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-10150a9f-2915-48c3-ae68-08274d208ef5 req-8106d2ee-a5c6-45b4-bed3-0e2130fd03c3 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:03.019348 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-10150a9f-2915-48c3-ae68-08274d208ef5 req-8106d2ee-a5c6-45b4-bed3-0e2130fd03c3 service nova] Creating event network-changed:93ed3518-1780-484d-ba95-946cdfd9103a for instance e8d4102a-6cfc-442e-aa11-c1af898bfedd on hv-cinder-82301 Dec 27 14:23:03.031615 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-10150a9f-2915-48c3-ae68-08274d208ef5 req-8106d2ee-a5c6-45b4-bed3-0e2130fd03c3 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077322 Dec 27 14:23:03.033684 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 182/321] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:23:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:23:03.100706 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-02d02efd-4599-42a5-a3b5-522bd26b566a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:03.101454 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-02d02efd-4599-42a5-a3b5-522bd26b566a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:03.113441 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-02d02efd-4599-42a5-a3b5-522bd26b566a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:03.114089 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-02d02efd-4599-42a5-a3b5-522bd26b566a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:03.114213 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f66d72c9-b2a7-494d-a1b6-58aaf76d30db tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:03.115093 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f66d72c9-b2a7-494d-a1b6-58aaf76d30db tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:03.115342 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-02d02efd-4599-42a5-a3b5-522bd26b566a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:03.115999 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-02d02efd-4599-42a5-a3b5-522bd26b566a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:03.135932 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f66d72c9-b2a7-494d-a1b6-58aaf76d30db tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:03.136391 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f66d72c9-b2a7-494d-a1b6-58aaf76d30db tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:03.143248 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f66d72c9-b2a7-494d-a1b6-58aaf76d30db tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:03.145595 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f66d72c9-b2a7-494d-a1b6-58aaf76d30db tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:03.406525 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-02d02efd-4599-42a5-a3b5-522bd26b566a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:03.415124 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-02d02efd-4599-42a5-a3b5-522bd26b566a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:03.417925 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-02d02efd-4599-42a5-a3b5-522bd26b566a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:03.419904 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-02d02efd-4599-42a5-a3b5-522bd26b566a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1406 microversion: 2.20 time: 0.329002 Dec 27 14:23:03.430276 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 140/322] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:23:03 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1406 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:23:03.435475 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cb1c52f5-0951-4a9a-b5b3-451784c2649d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:03.436667 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cb1c52f5-0951-4a9a-b5b3-451784c2649d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:03.442892 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cb1c52f5-0951-4a9a-b5b3-451784c2649d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:03.443572 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cb1c52f5-0951-4a9a-b5b3-451784c2649d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:03.444658 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cb1c52f5-0951-4a9a-b5b3-451784c2649d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:03.445248 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cb1c52f5-0951-4a9a-b5b3-451784c2649d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:03.497091 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cb1c52f5-0951-4a9a-b5b3-451784c2649d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065143 Dec 27 14:23:03.502583 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 141/323] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:23:03 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 27 14:23:03.507654 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-47044375-6d57-4b61-b0b8-ef9559e0c471 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:03.510902 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-47044375-6d57-4b61-b0b8-ef9559e0c471 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:03.519545 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47044375-6d57-4b61-b0b8-ef9559e0c471 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:03.520190 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47044375-6d57-4b61-b0b8-ef9559e0c471 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:03.521103 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47044375-6d57-4b61-b0b8-ef9559e0c471 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:03.521673 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47044375-6d57-4b61-b0b8-ef9559e0c471 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:03.538176 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f66d72c9-b2a7-494d-a1b6-58aaf76d30db tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:03.555594 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f66d72c9-b2a7-494d-a1b6-58aaf76d30db tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1522 microversion: 2.1 time: 0.445011 Dec 27 14:23:03.558123 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 183/324] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:03 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1522 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:03.569388 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-06a35219-ad37-4ab1-9ad5-7e87479d4166 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:03.570590 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-06a35219-ad37-4ab1-9ad5-7e87479d4166 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] [instance: e8d4102a-6cfc-442e-aa11-c1af898bfedd] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:03.578762 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-06a35219-ad37-4ab1-9ad5-7e87479d4166 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:03.579700 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-06a35219-ad37-4ab1-9ad5-7e87479d4166 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:03.580490 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-06a35219-ad37-4ab1-9ad5-7e87479d4166 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:03.581079 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-06a35219-ad37-4ab1-9ad5-7e87479d4166 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:03.607310 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-47044375-6d57-4b61-b0b8-ef9559e0c471 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28143 microversion: 2.1 time: 0.103166 Dec 27 14:23:03.613894 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 142/325] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:03 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28143 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:03.739526 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f59802ee-18ac-4830-b200-b8804406c4f0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2036051544", "imageRef": "c8bd383f-96c5-4e2b-aaa5-fabd68b307f6", "flavorRef": "452", "networks": [{"uuid": "f572a130-3f83-4c3c-b51f-af2b9bc79a2e"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:03.841154 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-f59802ee-18ac-4830-b200-b8804406c4f0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] validate_networks() for [('f572a130-3f83-4c3c-b51f-af2b9bc79a2e', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 27 14:23:04.135745 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-06a35219-ad37-4ab1-9ad5-7e87479d4166 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c343e960fb4bbe8dda23a8c338c2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca740df033cb4ee7a6a42fe098749e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:04.146049 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-06a35219-ad37-4ab1-9ad5-7e87479d4166 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] 10.222.0.37 "GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd" status: 200 len: 1315 microversion: 2.1 time: 0.580951 Dec 27 14:23:04.148401 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 184/326] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:03 2021] GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd => generated 1315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:04.155120 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c39b1dd7-aca7-4c75-b591-d2d8bcb0b5f3 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:04.157266 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c39b1dd7-aca7-4c75-b591-d2d8bcb0b5f3 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:04.177142 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c39b1dd7-aca7-4c75-b591-d2d8bcb0b5f3 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:04.180939 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c39b1dd7-aca7-4c75-b591-d2d8bcb0b5f3 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:04.182639 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c39b1dd7-aca7-4c75-b591-d2d8bcb0b5f3 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:04.185042 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c39b1dd7-aca7-4c75-b591-d2d8bcb0b5f3 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:04.422775 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-f59802ee-18ac-4830-b200-b8804406c4f0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 27 14:23:04.423287 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-f59802ee-18ac-4830-b200-b8804406c4f0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 27 14:23:04.423645 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-f59802ee-18ac-4830-b200-b8804406c4f0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 27 14:23:04.424357 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-f59802ee-18ac-4830-b200-b8804406c4f0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 27 14:23:04.425089 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-f59802ee-18ac-4830-b200-b8804406c4f0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 27 14:23:04.438109 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f59802ee-18ac-4830-b200-b8804406c4f0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:04.438554 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f59802ee-18ac-4830-b200-b8804406c4f0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:04.439505 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f59802ee-18ac-4830-b200-b8804406c4f0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:04.440171 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f59802ee-18ac-4830-b200-b8804406c4f0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:04.457621 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c39b1dd7-aca7-4c75-b591-d2d8bcb0b5f3 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:04.462072 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-f59802ee-18ac-4830-b200-b8804406c4f0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Getting quotas for project 648321538a5a439baf7e39cee8742fc4. Resources: {'cores', 'ram', 'instances'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:23:04.468854 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-f59802ee-18ac-4830-b200-b8804406c4f0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Getting quotas for user 2e4c89b986aa4f2690ee1587172c17cb and project 648321538a5a439baf7e39cee8742fc4. Resources: {'cores', 'ram', 'instances'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:23:04.470360 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c39b1dd7-aca7-4c75-b591-d2d8bcb0b5f3 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1358 microversion: 2.1 time: 0.318698 Dec 27 14:23:04.472219 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 185/327] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:04 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1358 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:04.477884 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b3355759-38f4-4328-a881-231f03b51118 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:04.479497 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b3355759-38f4-4328-a881-231f03b51118 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:04.484243 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f59802ee-18ac-4830-b200-b8804406c4f0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 27 14:23:04.487989 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f59802ee-18ac-4830-b200-b8804406c4f0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c8bd383f-96c5-4e2b-aaa5-fabd68b307f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 27 14:23:04.490417 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b3355759-38f4-4328-a881-231f03b51118 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:04.491204 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b3355759-38f4-4328-a881-231f03b51118 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:04.492917 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b3355759-38f4-4328-a881-231f03b51118 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:04.497120 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b3355759-38f4-4328-a881-231f03b51118 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:04.565926 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f59802ee-18ac-4830-b200-b8804406c4f0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.834115 Dec 27 14:23:04.570221 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 143/328] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Dec 27 14:23:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 27 14:23:04.578721 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e6588863-4262-43f1-8ce3-0cdc22fd00bd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:04.579767 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e6588863-4262-43f1-8ce3-0cdc22fd00bd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:04.588838 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6588863-4262-43f1-8ce3-0cdc22fd00bd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:04.589298 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6588863-4262-43f1-8ce3-0cdc22fd00bd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:04.590097 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6588863-4262-43f1-8ce3-0cdc22fd00bd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:04.590536 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e6588863-4262-43f1-8ce3-0cdc22fd00bd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:04.772341 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e6588863-4262-43f1-8ce3-0cdc22fd00bd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:04.780176 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e6588863-4262-43f1-8ce3-0cdc22fd00bd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1502 microversion: 2.1 time: 0.205288 Dec 27 14:23:04.788168 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 144/329] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:04 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1502 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:04.788168 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4b7f934c-7f21-4bb5-b408-88ab30e50322 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:04.788168 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4b7f934c-7f21-4bb5-b408-88ab30e50322 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:04.875540 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4b7f934c-7f21-4bb5-b408-88ab30e50322 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:04.884164 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4b7f934c-7f21-4bb5-b408-88ab30e50322 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49" status: 200 len: 1218 microversion: 2.1 time: 0.100109 Dec 27 14:23:04.885472 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b3355759-38f4-4328-a881-231f03b51118 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:04.895748 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 145/330] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:04 2021] GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:04.895748 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-96878012-cc1e-4f8f-9a3b-5d5b6504e0f4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:04.895748 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-96878012-cc1e-4f8f-9a3b-5d5b6504e0f4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:04.900146 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96878012-cc1e-4f8f-9a3b-5d5b6504e0f4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:04.900895 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96878012-cc1e-4f8f-9a3b-5d5b6504e0f4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:04.901834 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96878012-cc1e-4f8f-9a3b-5d5b6504e0f4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:04.902403 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96878012-cc1e-4f8f-9a3b-5d5b6504e0f4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:04.909693 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b3355759-38f4-4328-a881-231f03b51118 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:04.911504 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b3355759-38f4-4328-a881-231f03b51118 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:04.912934 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b3355759-38f4-4328-a881-231f03b51118 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1406 microversion: 2.20 time: 0.439363 Dec 27 14:23:04.924086 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 186/331] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:23:04 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1406 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:23:04.929666 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d70138f9-0a1d-4ef2-992b-a654d91aebec tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:04.930599 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d70138f9-0a1d-4ef2-992b-a654d91aebec tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:04.938547 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d70138f9-0a1d-4ef2-992b-a654d91aebec tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:04.939343 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d70138f9-0a1d-4ef2-992b-a654d91aebec tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:04.940566 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d70138f9-0a1d-4ef2-992b-a654d91aebec tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:04.941504 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d70138f9-0a1d-4ef2-992b-a654d91aebec tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:05.073549 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-96878012-cc1e-4f8f-9a3b-5d5b6504e0f4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28434 microversion: 2.1 time: 0.186142 Dec 27 14:23:05.074624 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 146/332] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:04 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28434 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:05.169967 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0b17bda9-0c24-400a-a4d8-537e734c572f tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:05.171071 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0b17bda9-0c24-400a-a4d8-537e734c572f tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] [instance: e8d4102a-6cfc-442e-aa11-c1af898bfedd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:05.195264 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0b17bda9-0c24-400a-a4d8-537e734c572f tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:05.196996 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0b17bda9-0c24-400a-a4d8-537e734c572f tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:05.202634 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0b17bda9-0c24-400a-a4d8-537e734c572f tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:05.203730 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0b17bda9-0c24-400a-a4d8-537e734c572f tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:05.237051 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d70138f9-0a1d-4ef2-992b-a654d91aebec tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:05.246187 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d70138f9-0a1d-4ef2-992b-a654d91aebec tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1515 microversion: 2.1 time: 0.320562 Dec 27 14:23:05.258972 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 187/333] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:04 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1515 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:05.413177 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0b17bda9-0c24-400a-a4d8-537e734c572f tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c343e960fb4bbe8dda23a8c338c2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca740df033cb4ee7a6a42fe098749e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:05.422122 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0b17bda9-0c24-400a-a4d8-537e734c572f tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] 10.222.0.37 "GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd" status: 200 len: 1315 microversion: 2.1 time: 0.260652 Dec 27 14:23:05.423167 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 147/334] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:05 2021] GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:05.487746 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2ce2451b-a4e7-4689-8fbd-6228bc45f731 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:05.488391 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2ce2451b-a4e7-4689-8fbd-6228bc45f731 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:05.495535 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2ce2451b-a4e7-4689-8fbd-6228bc45f731 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:05.495983 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2ce2451b-a4e7-4689-8fbd-6228bc45f731 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:05.496823 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2ce2451b-a4e7-4689-8fbd-6228bc45f731 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:05.497194 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2ce2451b-a4e7-4689-8fbd-6228bc45f731 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:05.657506 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-2ce2451b-a4e7-4689-8fbd-6228bc45f731 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:05.680001 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2ce2451b-a4e7-4689-8fbd-6228bc45f731 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1358 microversion: 2.1 time: 0.192295 Dec 27 14:23:05.680001 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 188/335] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:05 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:05.902725 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9021a2ed-057e-4767-8be1-039d0b7ba2c0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:05.903341 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9021a2ed-057e-4767-8be1-039d0b7ba2c0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:05.909920 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9021a2ed-057e-4767-8be1-039d0b7ba2c0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:05.910374 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9021a2ed-057e-4767-8be1-039d0b7ba2c0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:05.911163 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9021a2ed-057e-4767-8be1-039d0b7ba2c0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:05.911604 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9021a2ed-057e-4767-8be1-039d0b7ba2c0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:05.930107 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4942f771-3da9-437e-b34c-eca5c4c929b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:05.931322 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4942f771-3da9-437e-b34c-eca5c4c929b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:05.939044 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4942f771-3da9-437e-b34c-eca5c4c929b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:05.939496 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4942f771-3da9-437e-b34c-eca5c4c929b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:05.940325 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4942f771-3da9-437e-b34c-eca5c4c929b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:05.940765 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4942f771-3da9-437e-b34c-eca5c4c929b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:05.996615 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9021a2ed-057e-4767-8be1-039d0b7ba2c0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:06.011679 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9021a2ed-057e-4767-8be1-039d0b7ba2c0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49" status: 200 len: 1270 microversion: 2.1 time: 0.113006 Dec 27 14:23:06.012553 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 148/336] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:05 2021] GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49 => generated 1270 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:06.088988 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b9ee22e4-8968-47b1-9014-1b5e661c7636 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:06.091410 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b9ee22e4-8968-47b1-9014-1b5e661c7636 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:06.108166 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9ee22e4-8968-47b1-9014-1b5e661c7636 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:06.108978 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9ee22e4-8968-47b1-9014-1b5e661c7636 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:06.110229 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9ee22e4-8968-47b1-9014-1b5e661c7636 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:06.110935 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9ee22e4-8968-47b1-9014-1b5e661c7636 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:06.140155 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4942f771-3da9-437e-b34c-eca5c4c929b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:06.149890 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4942f771-3da9-437e-b34c-eca5c4c929b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:06.151955 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4942f771-3da9-437e-b34c-eca5c4c929b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:06.153441 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4942f771-3da9-437e-b34c-eca5c4c929b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1406 microversion: 2.20 time: 0.226991 Dec 27 14:23:06.154479 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 189/337] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:23:05 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:23:06.221989 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b9ee22e4-8968-47b1-9014-1b5e661c7636 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28434 microversion: 2.1 time: 0.138889 Dec 27 14:23:06.222985 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 149/338] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:06 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28434 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:23:06.439534 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0e8c6e1d-b49e-4740-bbec-df9e5e2150b9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:06.440219 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0e8c6e1d-b49e-4740-bbec-df9e5e2150b9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] [instance: e8d4102a-6cfc-442e-aa11-c1af898bfedd] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:06.448406 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0e8c6e1d-b49e-4740-bbec-df9e5e2150b9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:06.449132 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0e8c6e1d-b49e-4740-bbec-df9e5e2150b9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:06.450089 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0e8c6e1d-b49e-4740-bbec-df9e5e2150b9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:06.450681 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0e8c6e1d-b49e-4740-bbec-df9e5e2150b9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:06.696248 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1a7e46c2-118d-4c07-bfb3-c9226f6a3f85 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:06.697836 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0e8c6e1d-b49e-4740-bbec-df9e5e2150b9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c343e960fb4bbe8dda23a8c338c2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca740df033cb4ee7a6a42fe098749e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:06.698486 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1a7e46c2-118d-4c07-bfb3-c9226f6a3f85 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:06.709717 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1a7e46c2-118d-4c07-bfb3-c9226f6a3f85 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:06.710507 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1a7e46c2-118d-4c07-bfb3-c9226f6a3f85 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:06.711471 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1a7e46c2-118d-4c07-bfb3-c9226f6a3f85 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:06.711957 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0e8c6e1d-b49e-4740-bbec-df9e5e2150b9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] 10.222.0.37 "GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd" status: 200 len: 1315 microversion: 2.1 time: 0.274627 Dec 27 14:23:06.713057 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1a7e46c2-118d-4c07-bfb3-c9226f6a3f85 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:06.713204 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 190/339] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:06 2021] GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:06.804597 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-94272bdd-33c9-493b-acc2-86d5fa83707b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:06.806002 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-94272bdd-33c9-493b-acc2-86d5fa83707b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:06.813503 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-94272bdd-33c9-493b-acc2-86d5fa83707b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:06.814728 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-94272bdd-33c9-493b-acc2-86d5fa83707b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:06.815595 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-94272bdd-33c9-493b-acc2-86d5fa83707b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:06.816958 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-94272bdd-33c9-493b-acc2-86d5fa83707b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:06.844682 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.objects.instance [None req-94272bdd-33c9-493b-acc2-86d5fa83707b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lazy-loading 'flavor' on Instance uuid 8520422d-f3a9-443c-9e9a-12fb03ef1bcc {{(pid=116105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:23:06.988920 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1a7e46c2-118d-4c07-bfb3-c9226f6a3f85 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:07.001778 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-94272bdd-33c9-493b-acc2-86d5fa83707b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "POST /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc/action" status: 200 len: 32 microversion: 2.1 time: 0.202735 Dec 27 14:23:07.012324 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 191/340] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:06 2021] POST /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc/action => generated 32 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 27 14:23:07.013783 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1a7e46c2-118d-4c07-bfb3-c9226f6a3f85 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1358 microversion: 2.1 time: 0.322873 Dec 27 14:23:07.015500 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 150/341] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:06 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1358 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:07.021523 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8e56dbe6-ecf1-42f6-85ef-ba3371522896 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:07.022442 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8e56dbe6-ecf1-42f6-85ef-ba3371522896 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:07.031141 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f45acdb6-e41a-490c-8f60-2228664e3453 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:07.032143 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f45acdb6-e41a-490c-8f60-2228664e3453 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:07.037658 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8e56dbe6-ecf1-42f6-85ef-ba3371522896 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:07.038486 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8e56dbe6-ecf1-42f6-85ef-ba3371522896 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:07.040246 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8e56dbe6-ecf1-42f6-85ef-ba3371522896 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:07.041288 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8e56dbe6-ecf1-42f6-85ef-ba3371522896 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:07.046166 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f45acdb6-e41a-490c-8f60-2228664e3453 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:07.046630 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f45acdb6-e41a-490c-8f60-2228664e3453 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:07.048961 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f45acdb6-e41a-490c-8f60-2228664e3453 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:07.049643 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f45acdb6-e41a-490c-8f60-2228664e3453 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:07.257020 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8e56dbe6-ecf1-42f6-85ef-ba3371522896 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:07.282619 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8e56dbe6-ecf1-42f6-85ef-ba3371522896 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1521 microversion: 2.1 time: 0.268550 Dec 27 14:23:07.285836 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 192/342] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:07 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:07.299990 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-50af99a8-8d64-400a-b79d-c9cc5fc32a88 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:07.300983 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-50af99a8-8d64-400a-b79d-c9cc5fc32a88 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:07.311641 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-50af99a8-8d64-400a-b79d-c9cc5fc32a88 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:07.313394 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-50af99a8-8d64-400a-b79d-c9cc5fc32a88 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:07.316894 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-50af99a8-8d64-400a-b79d-c9cc5fc32a88 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:07.318389 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-50af99a8-8d64-400a-b79d-c9cc5fc32a88 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:07.377666 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f45acdb6-e41a-490c-8f60-2228664e3453 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:07.386703 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f45acdb6-e41a-490c-8f60-2228664e3453 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49" status: 200 len: 1318 microversion: 2.1 time: 0.359602 Dec 27 14:23:07.395428 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 151/343] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:07 2021] GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:07.400350 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6546090f-927d-489c-b919-33cc02c253e1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:07.401593 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6546090f-927d-489c-b919-33cc02c253e1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:07.408427 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6546090f-927d-489c-b919-33cc02c253e1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:07.409095 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6546090f-927d-489c-b919-33cc02c253e1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:07.410203 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6546090f-927d-489c-b919-33cc02c253e1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:07.410949 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6546090f-927d-489c-b919-33cc02c253e1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:07.580696 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6546090f-927d-489c-b919-33cc02c253e1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.183859 Dec 27 14:23:07.581773 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 152/344] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:07 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:07.658146 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-50af99a8-8d64-400a-b79d-c9cc5fc32a88 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:07.666333 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-50af99a8-8d64-400a-b79d-c9cc5fc32a88 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:07.668112 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-50af99a8-8d64-400a-b79d-c9cc5fc32a88 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:07.669407 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-50af99a8-8d64-400a-b79d-c9cc5fc32a88 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1406 microversion: 2.20 time: 0.381700 Dec 27 14:23:07.669964 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 193/345] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:23:07 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1406 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:23:07.731656 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-302c6ffa-842c-4ac9-9e8b-8fdf23653afd tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:07.732393 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-302c6ffa-842c-4ac9-9e8b-8fdf23653afd tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] [instance: e8d4102a-6cfc-442e-aa11-c1af898bfedd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:07.749579 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-302c6ffa-842c-4ac9-9e8b-8fdf23653afd tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:07.758599 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-302c6ffa-842c-4ac9-9e8b-8fdf23653afd tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:07.760885 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-302c6ffa-842c-4ac9-9e8b-8fdf23653afd tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:07.761436 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-302c6ffa-842c-4ac9-9e8b-8fdf23653afd tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:08.006943 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-302c6ffa-842c-4ac9-9e8b-8fdf23653afd tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c343e960fb4bbe8dda23a8c338c2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca740df033cb4ee7a6a42fe098749e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:08.016998 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-302c6ffa-842c-4ac9-9e8b-8fdf23653afd tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] 10.222.0.37 "GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd" status: 200 len: 1315 microversion: 2.1 time: 0.290968 Dec 27 14:23:08.017586 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 153/346] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:07 2021] GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:08.033110 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-47b226f5-a322-4cd9-bbbb-f0bdabbee628 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:08.033797 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-47b226f5-a322-4cd9-bbbb-f0bdabbee628 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:08.045066 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-47b226f5-a322-4cd9-bbbb-f0bdabbee628 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:08.045526 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-47b226f5-a322-4cd9-bbbb-f0bdabbee628 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:08.046338 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-47b226f5-a322-4cd9-bbbb-f0bdabbee628 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:08.046778 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-47b226f5-a322-4cd9-bbbb-f0bdabbee628 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:08.148241 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-977b021c-8bb6-47ee-b821-ed5a9213427d req-24b47ee1-6146-4eee-8c0d-cfec319616bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0599d7cc-289a-4244-b9ad-0a46071fbd49", "tag": "de0c9b82-59fd-43d3-bf0a-a38ca864e6de"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:08.150852 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:23:08.150852 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:23:08.173561 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-977b021c-8bb6-47ee-b821-ed5a9213427d req-24b47ee1-6146-4eee-8c0d-cfec319616bd service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:08.174031 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-977b021c-8bb6-47ee-b821-ed5a9213427d req-24b47ee1-6146-4eee-8c0d-cfec319616bd service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:08.186690 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-977b021c-8bb6-47ee-b821-ed5a9213427d req-24b47ee1-6146-4eee-8c0d-cfec319616bd service nova] Creating event network-changed:de0c9b82-59fd-43d3-bf0a-a38ca864e6de for instance 0599d7cc-289a-4244-b9ad-0a46071fbd49 on hv-cinder-82301 Dec 27 14:23:08.191628 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-977b021c-8bb6-47ee-b821-ed5a9213427d req-24b47ee1-6146-4eee-8c0d-cfec319616bd service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053938 Dec 27 14:23:08.192449 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 154/347] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:23:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:23:08.258217 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-47b226f5-a322-4cd9-bbbb-f0bdabbee628 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:08.266250 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-47b226f5-a322-4cd9-bbbb-f0bdabbee628 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1358 microversion: 2.1 time: 0.238579 Dec 27 14:23:08.266826 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 194/348] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:08 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:08.301417 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3e9edeb7-09ca-4141-a5da-5b760de5953f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:08.302221 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3e9edeb7-09ca-4141-a5da-5b760de5953f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:08.308900 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e9edeb7-09ca-4141-a5da-5b760de5953f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:08.309452 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e9edeb7-09ca-4141-a5da-5b760de5953f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:08.310240 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e9edeb7-09ca-4141-a5da-5b760de5953f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:08.310670 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e9edeb7-09ca-4141-a5da-5b760de5953f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:08.404614 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f4f87f07-613f-476f-90d2-9abcd3ef09d9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:08.405447 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f4f87f07-613f-476f-90d2-9abcd3ef09d9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:08.412097 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f4f87f07-613f-476f-90d2-9abcd3ef09d9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:08.412548 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f4f87f07-613f-476f-90d2-9abcd3ef09d9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:08.413927 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f4f87f07-613f-476f-90d2-9abcd3ef09d9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:08.414358 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f4f87f07-613f-476f-90d2-9abcd3ef09d9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:08.447975 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3e9edeb7-09ca-4141-a5da-5b760de5953f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:08.455454 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3e9edeb7-09ca-4141-a5da-5b760de5953f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1521 microversion: 2.1 time: 0.157986 Dec 27 14:23:08.456038 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 155/349] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:08 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:08.593021 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7cb2e5b7-d457-4c27-9080-a3b2b1b27975 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:08.594013 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7cb2e5b7-d457-4c27-9080-a3b2b1b27975 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:08.599919 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7cb2e5b7-d457-4c27-9080-a3b2b1b27975 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:08.600376 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7cb2e5b7-d457-4c27-9080-a3b2b1b27975 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:08.601158 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7cb2e5b7-d457-4c27-9080-a3b2b1b27975 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:08.601593 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7cb2e5b7-d457-4c27-9080-a3b2b1b27975 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:08.639526 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f4f87f07-613f-476f-90d2-9abcd3ef09d9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:08.646685 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f4f87f07-613f-476f-90d2-9abcd3ef09d9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49" status: 200 len: 1318 microversion: 2.1 time: 0.246304 Dec 27 14:23:08.647260 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 195/350] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:08 2021] GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:08.686508 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e7adb2c0-b049-4cab-97c6-2bc2a6031790 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:08.687117 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e7adb2c0-b049-4cab-97c6-2bc2a6031790 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:08.693040 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e7adb2c0-b049-4cab-97c6-2bc2a6031790 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:08.693491 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e7adb2c0-b049-4cab-97c6-2bc2a6031790 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:08.694261 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e7adb2c0-b049-4cab-97c6-2bc2a6031790 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:08.694692 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e7adb2c0-b049-4cab-97c6-2bc2a6031790 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:08.897380 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e7adb2c0-b049-4cab-97c6-2bc2a6031790 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:08.905801 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e7adb2c0-b049-4cab-97c6-2bc2a6031790 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:08.907627 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e7adb2c0-b049-4cab-97c6-2bc2a6031790 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:08.908786 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e7adb2c0-b049-4cab-97c6-2bc2a6031790 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1406 microversion: 2.20 time: 0.225851 Dec 27 14:23:08.909661 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 196/351] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:23:08 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:23:09.035178 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-20122587-83ad-436a-9aa4-619b7abffc9b tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:09.035874 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-20122587-83ad-436a-9aa4-619b7abffc9b tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] [instance: e8d4102a-6cfc-442e-aa11-c1af898bfedd] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:09.042306 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20122587-83ad-436a-9aa4-619b7abffc9b tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:09.042766 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20122587-83ad-436a-9aa4-619b7abffc9b tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:09.043548 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20122587-83ad-436a-9aa4-619b7abffc9b tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:09.044016 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20122587-83ad-436a-9aa4-619b7abffc9b tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:09.101041 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7cb2e5b7-d457-4c27-9080-a3b2b1b27975 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.510267 Dec 27 14:23:09.102360 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 156/352] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:08 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:23:09.201707 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bf170b19-8afb-4050-b9b6-713a273db39a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1172487343", "imageRef": "c8bd383f-96c5-4e2b-aaa5-fabd68b307f6", "flavorRef": "452", "networks": [{"uuid": "751637e1-6a5a-45f9-829a-2ac2c9824dd1"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:09.262215 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-bf170b19-8afb-4050-b9b6-713a273db39a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] validate_networks() for [('751637e1-6a5a-45f9-829a-2ac2c9824dd1', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 27 14:23:09.272664 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-20122587-83ad-436a-9aa4-619b7abffc9b tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c343e960fb4bbe8dda23a8c338c2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca740df033cb4ee7a6a42fe098749e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:09.282616 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-20122587-83ad-436a-9aa4-619b7abffc9b tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] 10.222.0.37 "GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd" status: 200 len: 1315 microversion: 2.1 time: 0.251374 Dec 27 14:23:09.294984 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 197/353] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:09 2021] GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:09.300026 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-00aa3677-9176-4dc1-a5f1-9c96b2a41665 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:09.300865 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-00aa3677-9176-4dc1-a5f1-9c96b2a41665 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:09.310547 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-00aa3677-9176-4dc1-a5f1-9c96b2a41665 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:09.311238 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-00aa3677-9176-4dc1-a5f1-9c96b2a41665 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:09.312305 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-00aa3677-9176-4dc1-a5f1-9c96b2a41665 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:09.312914 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-00aa3677-9176-4dc1-a5f1-9c96b2a41665 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:09.476472 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-00aa3677-9176-4dc1-a5f1-9c96b2a41665 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:09.484272 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-00aa3677-9176-4dc1-a5f1-9c96b2a41665 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1358 microversion: 2.1 time: 0.187818 Dec 27 14:23:09.485437 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 198/354] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:09 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:09.491799 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-33846325-b18c-481f-af90-e1a61c7fade1 req-1f6ecd31-0baf-46b1-b5d6-660ecedd5fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ff5786-5d44-438e-bb0a-f3fd05d83e40", "name": "network-vif-plugged", "status": "completed", "tag": "7e953f6b-a948-41fc-94f1-b04996e676ac"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:09.493878 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:23:09.493878 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:23:09.501622 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-33846325-b18c-481f-af90-e1a61c7fade1 req-1f6ecd31-0baf-46b1-b5d6-660ecedd5fc1 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:09.502175 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-33846325-b18c-481f-af90-e1a61c7fade1 req-1f6ecd31-0baf-46b1-b5d6-660ecedd5fc1 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:09.514084 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-33846325-b18c-481f-af90-e1a61c7fade1 req-1f6ecd31-0baf-46b1-b5d6-660ecedd5fc1 service nova] Creating event network-vif-plugged:7e953f6b-a948-41fc-94f1-b04996e676ac for instance 29ff5786-5d44-438e-bb0a-f3fd05d83e40 on hv-cinder-82301 Dec 27 14:23:09.519173 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-33846325-b18c-481f-af90-e1a61c7fade1 req-1f6ecd31-0baf-46b1-b5d6-660ecedd5fc1 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032509 Dec 27 14:23:09.519771 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 199/355] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:23:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:23:09.524689 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d188b9b6-1384-40cd-a62b-66dd18206bae tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:09.526120 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d188b9b6-1384-40cd-a62b-66dd18206bae tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:09.533471 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d188b9b6-1384-40cd-a62b-66dd18206bae tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:09.533924 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d188b9b6-1384-40cd-a62b-66dd18206bae tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:09.535236 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d188b9b6-1384-40cd-a62b-66dd18206bae tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:09.535677 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d188b9b6-1384-40cd-a62b-66dd18206bae tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:09.652993 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-bf170b19-8afb-4050-b9b6-713a273db39a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 27 14:23:09.653421 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-bf170b19-8afb-4050-b9b6-713a273db39a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 27 14:23:09.653891 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-bf170b19-8afb-4050-b9b6-713a273db39a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 27 14:23:09.654294 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-bf170b19-8afb-4050-b9b6-713a273db39a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 27 14:23:09.654702 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-bf170b19-8afb-4050-b9b6-713a273db39a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 27 14:23:09.668890 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bf170b19-8afb-4050-b9b6-713a273db39a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:09.669347 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bf170b19-8afb-4050-b9b6-713a273db39a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:09.670183 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bf170b19-8afb-4050-b9b6-713a273db39a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:09.670628 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bf170b19-8afb-4050-b9b6-713a273db39a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:09.680892 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d188b9b6-1384-40cd-a62b-66dd18206bae tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:09.689539 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d188b9b6-1384-40cd-a62b-66dd18206bae tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1521 microversion: 2.1 time: 0.168419 Dec 27 14:23:09.690210 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-bf170b19-8afb-4050-b9b6-713a273db39a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Getting quotas for project 6945d0284cf64136bf191e4e1ae16b37. Resources: {'cores', 'ram', 'instances'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:23:09.701260 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 200/356] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:09 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:09.701260 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-da0eb5fb-5311-44aa-ba3f-d418f943e488 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:09.701260 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-da0eb5fb-5311-44aa-ba3f-d418f943e488 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:09.705945 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-da0eb5fb-5311-44aa-ba3f-d418f943e488 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:09.706544 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-da0eb5fb-5311-44aa-ba3f-d418f943e488 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:09.707462 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-da0eb5fb-5311-44aa-ba3f-d418f943e488 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:09.708012 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-da0eb5fb-5311-44aa-ba3f-d418f943e488 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:09.708387 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-bf170b19-8afb-4050-b9b6-713a273db39a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Getting quotas for user eeb11dc4bf4c487a89a68500478f9e83 and project 6945d0284cf64136bf191e4e1ae16b37. Resources: {'cores', 'ram', 'instances'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:23:09.722436 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bf170b19-8afb-4050-b9b6-713a273db39a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 27 14:23:09.725149 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bf170b19-8afb-4050-b9b6-713a273db39a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c8bd383f-96c5-4e2b-aaa5-fabd68b307f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 27 14:23:09.774094 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bf170b19-8afb-4050-b9b6-713a273db39a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576858 Dec 27 14:23:09.777792 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 157/357] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Dec 27 14:23:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 27 14:23:09.785778 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-748bb282-375d-4072-b3c8-4ef7feef85cc tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:09.786814 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-748bb282-375d-4072-b3c8-4ef7feef85cc tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:09.842522 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-748bb282-375d-4072-b3c8-4ef7feef85cc tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:09.851720 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-748bb282-375d-4072-b3c8-4ef7feef85cc tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308" status: 200 len: 1219 microversion: 2.1 time: 0.070144 Dec 27 14:23:09.852336 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 158/358] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:09 2021] GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:09.870704 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-da0eb5fb-5311-44aa-ba3f-d418f943e488 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:09.877828 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-da0eb5fb-5311-44aa-ba3f-d418f943e488 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49" status: 200 len: 1318 microversion: 2.1 time: 0.185891 Dec 27 14:23:09.878385 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 201/359] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:09 2021] GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:09.926017 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-30ba025c-1327-4d12-a69a-521075e0b487 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:09.926615 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-30ba025c-1327-4d12-a69a-521075e0b487 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:09.932758 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-30ba025c-1327-4d12-a69a-521075e0b487 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:09.933204 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-30ba025c-1327-4d12-a69a-521075e0b487 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:09.933983 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-30ba025c-1327-4d12-a69a-521075e0b487 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:09.934413 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-30ba025c-1327-4d12-a69a-521075e0b487 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:10.091969 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-30ba025c-1327-4d12-a69a-521075e0b487 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:10.100368 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-30ba025c-1327-4d12-a69a-521075e0b487 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:10.102083 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-30ba025c-1327-4d12-a69a-521075e0b487 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:10.104434 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-30ba025c-1327-4d12-a69a-521075e0b487 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1406 microversion: 2.20 time: 0.181015 Dec 27 14:23:10.105008 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 159/360] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:23:09 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:23:10.113014 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6497c8af-3a62-4640-8660-3da1695fb752 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:10.114907 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6497c8af-3a62-4640-8660-3da1695fb752 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:10.122191 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6497c8af-3a62-4640-8660-3da1695fb752 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:10.122650 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6497c8af-3a62-4640-8660-3da1695fb752 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:10.123572 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6497c8af-3a62-4640-8660-3da1695fb752 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:10.124310 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6497c8af-3a62-4640-8660-3da1695fb752 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:10.213361 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6497c8af-3a62-4640-8660-3da1695fb752 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.103819 Dec 27 14:23:10.214020 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 202/361] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:10 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:10.299820 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-39ff273c-4ed3-45f7-92c7-737220ab19b0 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:10.300471 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-39ff273c-4ed3-45f7-92c7-737220ab19b0 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] [instance: e8d4102a-6cfc-442e-aa11-c1af898bfedd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:10.307435 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39ff273c-4ed3-45f7-92c7-737220ab19b0 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:10.307966 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39ff273c-4ed3-45f7-92c7-737220ab19b0 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:10.308801 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39ff273c-4ed3-45f7-92c7-737220ab19b0 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:10.309237 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-39ff273c-4ed3-45f7-92c7-737220ab19b0 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:10.443504 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-39ff273c-4ed3-45f7-92c7-737220ab19b0 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c343e960fb4bbe8dda23a8c338c2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca740df033cb4ee7a6a42fe098749e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:10.451434 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-39ff273c-4ed3-45f7-92c7-737220ab19b0 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] 10.222.0.37 "GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd" status: 200 len: 1315 microversion: 2.1 time: 0.155221 Dec 27 14:23:10.452025 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 160/362] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:10 2021] GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:10.501753 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d25888d6-d4a2-43f1-aaac-263e4202a29d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:10.502489 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d25888d6-d4a2-43f1-aaac-263e4202a29d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:10.509313 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d25888d6-d4a2-43f1-aaac-263e4202a29d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:10.510293 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d25888d6-d4a2-43f1-aaac-263e4202a29d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:10.511072 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d25888d6-d4a2-43f1-aaac-263e4202a29d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:10.511508 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d25888d6-d4a2-43f1-aaac-263e4202a29d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:10.642212 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d25888d6-d4a2-43f1-aaac-263e4202a29d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:10.650819 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d25888d6-d4a2-43f1-aaac-263e4202a29d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1358 microversion: 2.1 time: 0.152210 Dec 27 14:23:10.651392 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 203/363] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:10 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:10.708434 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-735de2f8-0528-48de-9943-12d2d7e18b68 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:10.708997 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-735de2f8-0528-48de-9943-12d2d7e18b68 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:10.715576 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-735de2f8-0528-48de-9943-12d2d7e18b68 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:10.716065 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-735de2f8-0528-48de-9943-12d2d7e18b68 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:10.716846 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-735de2f8-0528-48de-9943-12d2d7e18b68 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:10.717279 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-735de2f8-0528-48de-9943-12d2d7e18b68 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:10.844922 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-735de2f8-0528-48de-9943-12d2d7e18b68 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:10.852607 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-735de2f8-0528-48de-9943-12d2d7e18b68 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1521 microversion: 2.1 time: 0.147844 Dec 27 14:23:10.853180 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 161/364] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:10 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:10.870346 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-dcd37f0d-d553-4cf1-acfe-1f43002be762 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:10.871165 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-dcd37f0d-d553-4cf1-acfe-1f43002be762 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:10.877669 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dcd37f0d-d553-4cf1-acfe-1f43002be762 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:10.878854 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dcd37f0d-d553-4cf1-acfe-1f43002be762 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:10.879706 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dcd37f0d-d553-4cf1-acfe-1f43002be762 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:10.880481 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dcd37f0d-d553-4cf1-acfe-1f43002be762 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:10.894777 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f09b2247-d037-4519-8d4e-7873736cac64 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:10.895589 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f09b2247-d037-4519-8d4e-7873736cac64 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:10.903109 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f09b2247-d037-4519-8d4e-7873736cac64 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:10.903702 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f09b2247-d037-4519-8d4e-7873736cac64 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:10.904562 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f09b2247-d037-4519-8d4e-7873736cac64 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:10.905030 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f09b2247-d037-4519-8d4e-7873736cac64 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:10.999155 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-dcd37f0d-d553-4cf1-acfe-1f43002be762 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:11.012592 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-dcd37f0d-d553-4cf1-acfe-1f43002be762 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308" status: 200 len: 1279 microversion: 2.1 time: 0.147015 Dec 27 14:23:11.027273 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 204/365] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:10 2021] GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308 => generated 1279 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:11.070242 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f09b2247-d037-4519-8d4e-7873736cac64 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:11.084065 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f09b2247-d037-4519-8d4e-7873736cac64 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49" status: 200 len: 1318 microversion: 2.1 time: 0.187113 Dec 27 14:23:11.085287 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 162/366] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:10 2021] GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:11.123604 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3a0e51e6-c423-4329-b886-8ae62d6337e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:11.124907 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3a0e51e6-c423-4329-b886-8ae62d6337e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:11.133906 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a0e51e6-c423-4329-b886-8ae62d6337e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:11.135323 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a0e51e6-c423-4329-b886-8ae62d6337e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:11.136471 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a0e51e6-c423-4329-b886-8ae62d6337e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:11.137099 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a0e51e6-c423-4329-b886-8ae62d6337e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:11.225392 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-40319aa4-a3a0-4db9-ab22-30404e3b780d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:11.227014 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-40319aa4-a3a0-4db9-ab22-30404e3b780d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:11.233692 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-40319aa4-a3a0-4db9-ab22-30404e3b780d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:11.234330 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-40319aa4-a3a0-4db9-ab22-30404e3b780d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:11.235405 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-40319aa4-a3a0-4db9-ab22-30404e3b780d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:11.235858 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-40319aa4-a3a0-4db9-ab22-30404e3b780d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:11.362084 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3a0e51e6-c423-4329-b886-8ae62d6337e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:11.370982 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3a0e51e6-c423-4329-b886-8ae62d6337e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:11.372525 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3a0e51e6-c423-4329-b886-8ae62d6337e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:11.373643 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3a0e51e6-c423-4329-b886-8ae62d6337e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1406 microversion: 2.20 time: 0.255655 Dec 27 14:23:11.374203 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 205/367] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:23:11 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:23:11.427305 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-40319aa4-a3a0-4db9-ab22-30404e3b780d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.205750 Dec 27 14:23:11.427991 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 163/368] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:11 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:23:11.467928 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8bef9f38-8f4f-4a78-8fee-17c2078fa0dd tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:11.468544 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8bef9f38-8f4f-4a78-8fee-17c2078fa0dd tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] [instance: e8d4102a-6cfc-442e-aa11-c1af898bfedd] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:11.474884 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8bef9f38-8f4f-4a78-8fee-17c2078fa0dd tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:11.475338 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8bef9f38-8f4f-4a78-8fee-17c2078fa0dd tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:11.476224 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8bef9f38-8f4f-4a78-8fee-17c2078fa0dd tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:11.476586 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8bef9f38-8f4f-4a78-8fee-17c2078fa0dd tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:11.536873 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-0d2b2f2c-c3f0-4a65-9f71-efb813572bf6 req-1ad54de8-289a-4617-a894-4af0d1e3d24e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aad07b94-d83b-4d44-856c-80ac2e24b8b4", "name": "network-vif-plugged", "status": "completed", "tag": "d8953eb3-d364-4473-98c5-e33562dcd960"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:11.538389 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:23:11.538389 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:23:11.546952 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-0d2b2f2c-c3f0-4a65-9f71-efb813572bf6 req-1ad54de8-289a-4617-a894-4af0d1e3d24e service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:11.547394 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-0d2b2f2c-c3f0-4a65-9f71-efb813572bf6 req-1ad54de8-289a-4617-a894-4af0d1e3d24e service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:11.560846 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-0d2b2f2c-c3f0-4a65-9f71-efb813572bf6 req-1ad54de8-289a-4617-a894-4af0d1e3d24e service nova] Creating event network-vif-plugged:d8953eb3-d364-4473-98c5-e33562dcd960 for instance aad07b94-d83b-4d44-856c-80ac2e24b8b4 on hv-cinder-82301 Dec 27 14:23:11.565735 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-0d2b2f2c-c3f0-4a65-9f71-efb813572bf6 req-1ad54de8-289a-4617-a894-4af0d1e3d24e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032764 Dec 27 14:23:11.566349 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 164/369] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:23:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:23:11.669100 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5f3994e0-5b63-4b41-9207-e74c3cf92677 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:11.669820 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5f3994e0-5b63-4b41-9207-e74c3cf92677 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:11.676653 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f3994e0-5b63-4b41-9207-e74c3cf92677 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:11.677107 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f3994e0-5b63-4b41-9207-e74c3cf92677 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:11.677854 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f3994e0-5b63-4b41-9207-e74c3cf92677 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:11.678287 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f3994e0-5b63-4b41-9207-e74c3cf92677 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:11.881862 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5f3994e0-5b63-4b41-9207-e74c3cf92677 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:11.889253 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5f3994e0-5b63-4b41-9207-e74c3cf92677 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1358 microversion: 2.1 time: 0.224705 Dec 27 14:23:11.890171 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 165/370] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:11 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:11.894258 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8d8b0ad4-10a2-4bda-acf0-730473c7798c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:11.894861 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8d8b0ad4-10a2-4bda-acf0-730473c7798c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:11.901855 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8d8b0ad4-10a2-4bda-acf0-730473c7798c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:11.902310 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8d8b0ad4-10a2-4bda-acf0-730473c7798c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:11.903100 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8d8b0ad4-10a2-4bda-acf0-730473c7798c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:11.903535 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8d8b0ad4-10a2-4bda-acf0-730473c7798c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:11.914510 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8bef9f38-8f4f-4a78-8fee-17c2078fa0dd tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c343e960fb4bbe8dda23a8c338c2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca740df033cb4ee7a6a42fe098749e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:11.922911 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8bef9f38-8f4f-4a78-8fee-17c2078fa0dd tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] 10.222.0.37 "GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd" status: 200 len: 1315 microversion: 2.1 time: 0.458540 Dec 27 14:23:11.932501 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 206/371] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:11 2021] GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:12.036103 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-925c310e-17db-49a7-8672-2faaee353c2b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:12.036734 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-925c310e-17db-49a7-8672-2faaee353c2b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:12.042349 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8d8b0ad4-10a2-4bda-acf0-730473c7798c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:12.042661 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-925c310e-17db-49a7-8672-2faaee353c2b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:12.043106 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-925c310e-17db-49a7-8672-2faaee353c2b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:12.043914 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-925c310e-17db-49a7-8672-2faaee353c2b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:12.044851 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-925c310e-17db-49a7-8672-2faaee353c2b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:12.049990 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8d8b0ad4-10a2-4bda-acf0-730473c7798c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1521 microversion: 2.1 time: 0.159038 Dec 27 14:23:12.059794 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 166/372] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:11 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:12.104092 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8a79e388-3c14-4864-b316-ce38c0fc113c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:12.104705 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8a79e388-3c14-4864-b316-ce38c0fc113c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:12.110784 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a79e388-3c14-4864-b316-ce38c0fc113c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:12.111256 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a79e388-3c14-4864-b316-ce38c0fc113c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:12.112066 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a79e388-3c14-4864-b316-ce38c0fc113c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:12.112500 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8a79e388-3c14-4864-b316-ce38c0fc113c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:12.182624 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-925c310e-17db-49a7-8672-2faaee353c2b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:12.190214 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-925c310e-17db-49a7-8672-2faaee353c2b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308" status: 200 len: 1319 microversion: 2.1 time: 0.158075 Dec 27 14:23:12.190780 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 207/373] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:12 2021] GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:12.248110 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8a79e388-3c14-4864-b316-ce38c0fc113c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:12.255387 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8a79e388-3c14-4864-b316-ce38c0fc113c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49" status: 200 len: 1318 microversion: 2.1 time: 0.155344 Dec 27 14:23:12.255972 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 167/374] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:12 2021] GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:12.391127 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a551ffc2-8a9a-416c-a007-8eefebcfe49e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:12.391725 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a551ffc2-8a9a-416c-a007-8eefebcfe49e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:12.397771 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a551ffc2-8a9a-416c-a007-8eefebcfe49e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:12.398403 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a551ffc2-8a9a-416c-a007-8eefebcfe49e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:12.399179 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a551ffc2-8a9a-416c-a007-8eefebcfe49e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:12.399607 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a551ffc2-8a9a-416c-a007-8eefebcfe49e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:12.440229 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ea278e03-c460-4769-a1e7-d9552fee934f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:12.441225 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ea278e03-c460-4769-a1e7-d9552fee934f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:12.447787 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea278e03-c460-4769-a1e7-d9552fee934f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:12.448261 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea278e03-c460-4769-a1e7-d9552fee934f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:12.449040 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea278e03-c460-4769-a1e7-d9552fee934f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:12.449466 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea278e03-c460-4769-a1e7-d9552fee934f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:12.563661 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ea278e03-c460-4769-a1e7-d9552fee934f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.127035 Dec 27 14:23:12.565209 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 168/375] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:12 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:23:12.660924 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a551ffc2-8a9a-416c-a007-8eefebcfe49e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:12.669476 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a551ffc2-8a9a-416c-a007-8eefebcfe49e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:12.671137 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a551ffc2-8a9a-416c-a007-8eefebcfe49e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:12.672378 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a551ffc2-8a9a-416c-a007-8eefebcfe49e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1406 microversion: 2.20 time: 0.285168 Dec 27 14:23:12.673150 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 208/376] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:23:12 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1406 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:23:12.907690 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-786bfa21-e102-401a-93f9-0900e3e028eb tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:12.908583 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-786bfa21-e102-401a-93f9-0900e3e028eb tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:12.915549 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-786bfa21-e102-401a-93f9-0900e3e028eb tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:12.916036 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-786bfa21-e102-401a-93f9-0900e3e028eb tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:12.916828 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-786bfa21-e102-401a-93f9-0900e3e028eb tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:12.917261 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-786bfa21-e102-401a-93f9-0900e3e028eb tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:12.939929 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-72d1e376-84bf-4cbd-a76c-f261359122e4 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:12.940570 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-72d1e376-84bf-4cbd-a76c-f261359122e4 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] [instance: e8d4102a-6cfc-442e-aa11-c1af898bfedd] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:12.946580 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72d1e376-84bf-4cbd-a76c-f261359122e4 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:12.947527 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72d1e376-84bf-4cbd-a76c-f261359122e4 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:12.948353 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72d1e376-84bf-4cbd-a76c-f261359122e4 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:12.948797 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72d1e376-84bf-4cbd-a76c-f261359122e4 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:13.059665 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-786bfa21-e102-401a-93f9-0900e3e028eb tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:13.067540 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-786bfa21-e102-401a-93f9-0900e3e028eb tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1549 microversion: 2.1 time: 0.164139 Dec 27 14:23:13.068148 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 169/377] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:12 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:13.074606 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-12479617-4ccf-4d11-803f-1395a5fc2a65 req-c04aaa28-8e1c-4054-8cac-e953ff48d98b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77e5bc07-27af-405b-8aa6-c46ab71c6308", "tag": "b0dc9db5-833a-4012-9679-5e5a903f1834"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:13.080936 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:23:13.080936 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:23:13.089253 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-12479617-4ccf-4d11-803f-1395a5fc2a65 req-c04aaa28-8e1c-4054-8cac-e953ff48d98b service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:13.089709 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-12479617-4ccf-4d11-803f-1395a5fc2a65 req-c04aaa28-8e1c-4054-8cac-e953ff48d98b service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:13.100836 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-12479617-4ccf-4d11-803f-1395a5fc2a65 req-c04aaa28-8e1c-4054-8cac-e953ff48d98b service nova] Creating event network-changed:b0dc9db5-833a-4012-9679-5e5a903f1834 for instance 77e5bc07-27af-405b-8aa6-c46ab71c6308 on hv-cinder-82301 Dec 27 14:23:13.108558 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-12479617-4ccf-4d11-803f-1395a5fc2a65 req-c04aaa28-8e1c-4054-8cac-e953ff48d98b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038981 Dec 27 14:23:13.109640 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 170/378] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:23:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:23:13.116349 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f47057fa-e923-4dfa-93c0-bc950028896f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:13.118297 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f47057fa-e923-4dfa-93c0-bc950028896f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:13.129298 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f47057fa-e923-4dfa-93c0-bc950028896f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:13.129997 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f47057fa-e923-4dfa-93c0-bc950028896f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:13.131270 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f47057fa-e923-4dfa-93c0-bc950028896f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:13.131965 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f47057fa-e923-4dfa-93c0-bc950028896f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:13.272892 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-72d1e376-84bf-4cbd-a76c-f261359122e4 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c343e960fb4bbe8dda23a8c338c2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca740df033cb4ee7a6a42fe098749e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:13.281639 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f47057fa-e923-4dfa-93c0-bc950028896f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:13.284950 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-72d1e376-84bf-4cbd-a76c-f261359122e4 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] 10.222.0.37 "GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd" status: 200 len: 1315 microversion: 2.1 time: 0.348222 Dec 27 14:23:13.285888 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 209/379] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:12 2021] GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:13.290526 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f47057fa-e923-4dfa-93c0-bc950028896f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1521 microversion: 2.1 time: 0.179537 Dec 27 14:23:13.292623 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-95037dca-e6da-4399-850e-47d1deb34eec tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:13.293913 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-95037dca-e6da-4399-850e-47d1deb34eec tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:13.301140 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 171/380] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:13 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:13.301628 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-95037dca-e6da-4399-850e-47d1deb34eec tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:13.303242 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-95037dca-e6da-4399-850e-47d1deb34eec tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:13.304607 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-95037dca-e6da-4399-850e-47d1deb34eec tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:13.305239 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-95037dca-e6da-4399-850e-47d1deb34eec tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:13.305859 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-42cde35e-6740-4c3f-8622-bb95f51aa36b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:13.306611 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-42cde35e-6740-4c3f-8622-bb95f51aa36b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:13.314019 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42cde35e-6740-4c3f-8622-bb95f51aa36b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:13.314697 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42cde35e-6740-4c3f-8622-bb95f51aa36b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:13.315987 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42cde35e-6740-4c3f-8622-bb95f51aa36b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:13.316581 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42cde35e-6740-4c3f-8622-bb95f51aa36b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:13.582249 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-95037dca-e6da-4399-850e-47d1deb34eec tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:13.592551 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-95037dca-e6da-4399-850e-47d1deb34eec tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1549 microversion: 2.1 time: 0.305598 Dec 27 14:23:13.601252 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 210/381] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:13 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1549 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:13.605912 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9132d380-1df9-4f69-bf69-c6f526317233 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:13.606697 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9132d380-1df9-4f69-bf69-c6f526317233 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:13.612855 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9132d380-1df9-4f69-bf69-c6f526317233 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:13.613302 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9132d380-1df9-4f69-bf69-c6f526317233 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:13.614086 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9132d380-1df9-4f69-bf69-c6f526317233 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:13.614702 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9132d380-1df9-4f69-bf69-c6f526317233 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:13.679186 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-42cde35e-6740-4c3f-8622-bb95f51aa36b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:13.689205 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-42cde35e-6740-4c3f-8622-bb95f51aa36b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308" status: 200 len: 1319 microversion: 2.1 time: 0.385199 Dec 27 14:23:13.689205 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 172/382] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:13 2021] GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308 => generated 1319 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:13.701959 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7fef1268-054c-4618-b08e-022e14c9cb57 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:13.703041 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7fef1268-054c-4618-b08e-022e14c9cb57 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:13.709264 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7fef1268-054c-4618-b08e-022e14c9cb57 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:13.709707 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7fef1268-054c-4618-b08e-022e14c9cb57 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:13.710540 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7fef1268-054c-4618-b08e-022e14c9cb57 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:13.710969 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7fef1268-054c-4618-b08e-022e14c9cb57 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:13.836645 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9132d380-1df9-4f69-bf69-c6f526317233 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:13.844055 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9132d380-1df9-4f69-bf69-c6f526317233 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49" status: 200 len: 1318 microversion: 2.1 time: 0.249904 Dec 27 14:23:13.844625 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 211/383] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:13 2021] GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:13.853773 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-5a7c0b3c-0da8-4260-a357-c978f23c634b req-1a8a97d5-3613-42d4-9da1-8d2fe13d3f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d4102a-6cfc-442e-aa11-c1af898bfedd", "name": "network-vif-plugged", "status": "completed", "tag": "93ed3518-1780-484d-ba95-946cdfd9103a"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:13.853773 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:23:13.853773 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:23:13.857426 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-5a7c0b3c-0da8-4260-a357-c978f23c634b req-1a8a97d5-3613-42d4-9da1-8d2fe13d3f11 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:13.857866 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-5a7c0b3c-0da8-4260-a357-c978f23c634b req-1a8a97d5-3613-42d4-9da1-8d2fe13d3f11 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:13.868616 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-5a7c0b3c-0da8-4260-a357-c978f23c634b req-1a8a97d5-3613-42d4-9da1-8d2fe13d3f11 service nova] Creating event network-vif-plugged:93ed3518-1780-484d-ba95-946cdfd9103a for instance e8d4102a-6cfc-442e-aa11-c1af898bfedd on hv-cinder-82301 Dec 27 14:23:13.873985 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-5a7c0b3c-0da8-4260-a357-c978f23c634b req-1a8a97d5-3613-42d4-9da1-8d2fe13d3f11 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028231 Dec 27 14:23:13.874570 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 212/384] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:23:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:23:13.879167 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6bb7d576-b43a-4ecd-86e9-18cba13e8966 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:13.882430 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:23:13.882430 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:23:13.883408 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6bb7d576-b43a-4ecd-86e9-18cba13e8966 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:13.884162 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6bb7d576-b43a-4ecd-86e9-18cba13e8966 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Searching by: {'deleted': False, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4'} {{(pid=116105) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 27 14:23:13.890604 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6bb7d576-b43a-4ecd-86e9-18cba13e8966 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:13.891063 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6bb7d576-b43a-4ecd-86e9-18cba13e8966 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:13.891910 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6bb7d576-b43a-4ecd-86e9-18cba13e8966 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:13.892344 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6bb7d576-b43a-4ecd-86e9-18cba13e8966 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:13.990838 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.multi_cell_list [None req-6bb7d576-b43a-4ecd-86e9-18cba13e8966 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116105) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 27 14:23:14.054272 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7fef1268-054c-4618-b08e-022e14c9cb57 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.360792 Dec 27 14:23:14.058560 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 173/385] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:13 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:14.060623 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c2fe42dd-0e55-42e1-838b-9847d13e03ec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:14.061814 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c2fe42dd-0e55-42e1-838b-9847d13e03ec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:14.078550 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c2fe42dd-0e55-42e1-838b-9847d13e03ec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:14.079011 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c2fe42dd-0e55-42e1-838b-9847d13e03ec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:14.087939 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c2fe42dd-0e55-42e1-838b-9847d13e03ec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:14.089505 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c2fe42dd-0e55-42e1-838b-9847d13e03ec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:14.121101 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6bb7d576-b43a-4ecd-86e9-18cba13e8966 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.245273 Dec 27 14:23:14.121719 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 213/386] 10.222.0.37 () {58 vars in 1124 bytes} [Mon Dec 27 14:23:13 2021] GET /compute/v2.1/servers => generated 342 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:23:14.138873 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5f51affd-22bf-4c07-8432-af4001da7e97 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:14.143205 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5f51affd-22bf-4c07-8432-af4001da7e97 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:14.150539 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5f51affd-22bf-4c07-8432-af4001da7e97 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:14.151145 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5f51affd-22bf-4c07-8432-af4001da7e97 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:14.152269 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5f51affd-22bf-4c07-8432-af4001da7e97 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:14.152436 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5f51affd-22bf-4c07-8432-af4001da7e97 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:14.302949 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c2fe42dd-0e55-42e1-838b-9847d13e03ec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:14.313032 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c2fe42dd-0e55-42e1-838b-9847d13e03ec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:14.314528 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c2fe42dd-0e55-42e1-838b-9847d13e03ec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:14.315663 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c2fe42dd-0e55-42e1-838b-9847d13e03ec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1406 microversion: 2.20 time: 0.259654 Dec 27 14:23:14.316254 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 174/387] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:23:14 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1406 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:23:14.320397 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c03e5f69-42e8-49e6-b989-b09d0f2c222e tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:14.320998 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c03e5f69-42e8-49e6-b989-b09d0f2c222e tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] [instance: e8d4102a-6cfc-442e-aa11-c1af898bfedd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:14.327228 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c03e5f69-42e8-49e6-b989-b09d0f2c222e tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:14.327673 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c03e5f69-42e8-49e6-b989-b09d0f2c222e tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:14.328515 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c03e5f69-42e8-49e6-b989-b09d0f2c222e tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:14.328949 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c03e5f69-42e8-49e6-b989-b09d0f2c222e tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:14.334635 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5f51affd-22bf-4c07-8432-af4001da7e97 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:14.343043 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5f51affd-22bf-4c07-8432-af4001da7e97 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1549 microversion: 2.1 time: 0.215013 Dec 27 14:23:14.343608 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 214/388] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:14 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1549 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:14.347902 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5e74d3fe-697e-4c9d-8963-6a1e6c96560a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:14.348494 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5e74d3fe-697e-4c9d-8963-6a1e6c96560a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:14.354603 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5e74d3fe-697e-4c9d-8963-6a1e6c96560a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:14.355049 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5e74d3fe-697e-4c9d-8963-6a1e6c96560a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:14.355822 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5e74d3fe-697e-4c9d-8963-6a1e6c96560a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:14.356280 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5e74d3fe-697e-4c9d-8963-6a1e6c96560a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:14.472809 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c03e5f69-42e8-49e6-b989-b09d0f2c222e tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c343e960fb4bbe8dda23a8c338c2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca740df033cb4ee7a6a42fe098749e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:14.480442 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c03e5f69-42e8-49e6-b989-b09d0f2c222e tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] 10.222.0.37 "GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd" status: 200 len: 1315 microversion: 2.1 time: 0.163213 Dec 27 14:23:14.481010 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 175/389] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:14 2021] GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:14.497481 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5e74d3fe-697e-4c9d-8963-6a1e6c96560a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:14.505949 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5e74d3fe-697e-4c9d-8963-6a1e6c96560a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1521 microversion: 2.1 time: 0.161230 Dec 27 14:23:14.515869 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 215/390] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:14 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:14.705508 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2c212c93-e214-4ec6-81f1-88ac75e048b6 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:14.706227 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2c212c93-e214-4ec6-81f1-88ac75e048b6 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:14.713121 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c212c93-e214-4ec6-81f1-88ac75e048b6 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:14.713606 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c212c93-e214-4ec6-81f1-88ac75e048b6 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:14.714392 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c212c93-e214-4ec6-81f1-88ac75e048b6 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:14.714827 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c212c93-e214-4ec6-81f1-88ac75e048b6 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:14.841811 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2c212c93-e214-4ec6-81f1-88ac75e048b6 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:14.848975 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2c212c93-e214-4ec6-81f1-88ac75e048b6 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308" status: 200 len: 1319 microversion: 2.1 time: 0.147317 Dec 27 14:23:14.849537 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 176/391] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:14 2021] GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:14.861161 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d57c877e-1c1e-4f86-9956-78fe2903f868 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:14.861807 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d57c877e-1c1e-4f86-9956-78fe2903f868 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:14.868351 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d57c877e-1c1e-4f86-9956-78fe2903f868 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:14.869364 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d57c877e-1c1e-4f86-9956-78fe2903f868 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:14.870177 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d57c877e-1c1e-4f86-9956-78fe2903f868 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:14.870606 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d57c877e-1c1e-4f86-9956-78fe2903f868 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:14.999486 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d57c877e-1c1e-4f86-9956-78fe2903f868 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:15.006711 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d57c877e-1c1e-4f86-9956-78fe2903f868 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49" status: 200 len: 1318 microversion: 2.1 time: 0.149377 Dec 27 14:23:15.007281 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 216/392] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:14 2021] GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:15.065980 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b05d0d85-2d4d-4c87-ae43-9069b949e0fd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:15.066888 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b05d0d85-2d4d-4c87-ae43-9069b949e0fd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:15.073554 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b05d0d85-2d4d-4c87-ae43-9069b949e0fd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:15.073996 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b05d0d85-2d4d-4c87-ae43-9069b949e0fd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:15.074774 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b05d0d85-2d4d-4c87-ae43-9069b949e0fd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:15.075205 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b05d0d85-2d4d-4c87-ae43-9069b949e0fd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:15.158937 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b05d0d85-2d4d-4c87-ae43-9069b949e0fd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.096168 Dec 27 14:23:15.159662 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 177/393] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:15 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:15.333329 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b28b6415-6e27-41a5-8ea6-f0cce5648b63 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:15.333947 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b28b6415-6e27-41a5-8ea6-f0cce5648b63 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:15.339783 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b28b6415-6e27-41a5-8ea6-f0cce5648b63 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:15.340365 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b28b6415-6e27-41a5-8ea6-f0cce5648b63 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:15.341009 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b28b6415-6e27-41a5-8ea6-f0cce5648b63 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:15.341436 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b28b6415-6e27-41a5-8ea6-f0cce5648b63 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:15.475430 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b28b6415-6e27-41a5-8ea6-f0cce5648b63 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:15.483718 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b28b6415-6e27-41a5-8ea6-f0cce5648b63 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:15.485247 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b28b6415-6e27-41a5-8ea6-f0cce5648b63 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:15.486384 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b28b6415-6e27-41a5-8ea6-f0cce5648b63 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1598 microversion: 2.20 time: 0.156786 Dec 27 14:23:15.486937 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 217/394] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:23:15 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:23:15.497775 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-317e1d7a-3f20-4c24-99bc-5df7939d04f9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:15.498472 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-317e1d7a-3f20-4c24-99bc-5df7939d04f9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] [instance: e8d4102a-6cfc-442e-aa11-c1af898bfedd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:15.504132 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1b837e90-889c-4810-a659-18d5d33cd3ad tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:15.504735 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1b837e90-889c-4810-a659-18d5d33cd3ad tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:15.505801 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-317e1d7a-3f20-4c24-99bc-5df7939d04f9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:15.506245 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-317e1d7a-3f20-4c24-99bc-5df7939d04f9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:15.507038 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-317e1d7a-3f20-4c24-99bc-5df7939d04f9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:15.507476 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-317e1d7a-3f20-4c24-99bc-5df7939d04f9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:15.511365 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1b837e90-889c-4810-a659-18d5d33cd3ad tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:15.511817 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1b837e90-889c-4810-a659-18d5d33cd3ad tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:15.512625 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1b837e90-889c-4810-a659-18d5d33cd3ad tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:15.513054 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1b837e90-889c-4810-a659-18d5d33cd3ad tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:15.593483 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1b837e90-889c-4810-a659-18d5d33cd3ad tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092998 Dec 27 14:23:15.594080 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 218/395] 10.222.0.37 () {60 vars in 1315 bytes} [Mon Dec 27 14:23:15 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:23:15.598501 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-26d440f0-4009-494a-bec3-490960a4e3f2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:15.599102 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-26d440f0-4009-494a-bec3-490960a4e3f2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:15.605886 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-26d440f0-4009-494a-bec3-490960a4e3f2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:15.606331 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-26d440f0-4009-494a-bec3-490960a4e3f2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:15.607129 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-26d440f0-4009-494a-bec3-490960a4e3f2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:15.607563 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-26d440f0-4009-494a-bec3-490960a4e3f2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:15.645930 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-317e1d7a-3f20-4c24-99bc-5df7939d04f9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c343e960fb4bbe8dda23a8c338c2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca740df033cb4ee7a6a42fe098749e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:15.654156 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-317e1d7a-3f20-4c24-99bc-5df7939d04f9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] 10.222.0.37 "GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd" status: 200 len: 1315 microversion: 2.1 time: 0.160696 Dec 27 14:23:15.660313 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 178/396] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:15 2021] GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:15.853917 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-99d87bae-b0f3-4316-a169-1bbb317953d2 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efc5223a-03d9-4e17-b346-fd2029ef2406"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:15.855505 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-99d87bae-b0f3-4316-a169-1bbb317953d2 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:15.862867 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99d87bae-b0f3-4316-a169-1bbb317953d2 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:15.863318 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99d87bae-b0f3-4316-a169-1bbb317953d2 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:15.864781 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99d87bae-b0f3-4316-a169-1bbb317953d2 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:15.865406 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99d87bae-b0f3-4316-a169-1bbb317953d2 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:15.867306 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-26d440f0-4009-494a-bec3-490960a4e3f2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:15.875424 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-26d440f0-4009-494a-bec3-490960a4e3f2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1521 microversion: 2.1 time: 0.280235 Dec 27 14:23:15.881749 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 219/397] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:15 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:15.881749 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-31a6551e-80dc-4ca5-b481-6325ad327304 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:15.881749 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-31a6551e-80dc-4ca5-b481-6325ad327304 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:15.888407 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31a6551e-80dc-4ca5-b481-6325ad327304 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:15.889032 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31a6551e-80dc-4ca5-b481-6325ad327304 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:15.889912 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31a6551e-80dc-4ca5-b481-6325ad327304 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:15.890445 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31a6551e-80dc-4ca5-b481-6325ad327304 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:16.142211 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-99d87bae-b0f3-4316-a169-1bbb317953d2 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "POST /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292596 Dec 27 14:23:16.148061 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 179/398] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Dec 27 14:23:15 2021] POST /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:23:16.153327 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ea1b9d62-772b-49fe-9597-30a5679d37c3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:16.154600 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ea1b9d62-772b-49fe-9597-30a5679d37c3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:16.161572 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea1b9d62-772b-49fe-9597-30a5679d37c3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:16.162022 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea1b9d62-772b-49fe-9597-30a5679d37c3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:16.162810 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea1b9d62-772b-49fe-9597-30a5679d37c3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:16.163240 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ea1b9d62-772b-49fe-9597-30a5679d37c3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:16.193651 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-31a6551e-80dc-4ca5-b481-6325ad327304 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:16.208311 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-31a6551e-80dc-4ca5-b481-6325ad327304 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308" status: 200 len: 1319 microversion: 2.1 time: 0.331043 Dec 27 14:23:16.208892 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 220/399] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:15 2021] GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308 => generated 1319 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:16.220334 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-eb4c4b50-e5c9-485c-87c8-861005fca172 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:16.220334 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-eb4c4b50-e5c9-485c-87c8-861005fca172 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:16.220998 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb4c4b50-e5c9-485c-87c8-861005fca172 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:16.221564 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb4c4b50-e5c9-485c-87c8-861005fca172 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:16.233241 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb4c4b50-e5c9-485c-87c8-861005fca172 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:16.233700 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb4c4b50-e5c9-485c-87c8-861005fca172 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:16.341015 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ea1b9d62-772b-49fe-9597-30a5679d37c3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:16.348902 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ea1b9d62-772b-49fe-9597-30a5679d37c3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49" status: 200 len: 1318 microversion: 2.1 time: 0.199595 Dec 27 14:23:16.353660 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-eb4c4b50-e5c9-485c-87c8-861005fca172 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.143205 Dec 27 14:23:16.355235 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 221/400] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:16 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:16.360565 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 180/401] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:16 2021] GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:16.672148 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-66fdcc47-fdb3-4b37-8952-0f20c430f643 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:16.672735 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-66fdcc47-fdb3-4b37-8952-0f20c430f643 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] [instance: e8d4102a-6cfc-442e-aa11-c1af898bfedd] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:16.680363 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-66fdcc47-fdb3-4b37-8952-0f20c430f643 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:16.680801 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-66fdcc47-fdb3-4b37-8952-0f20c430f643 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:16.682198 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-66fdcc47-fdb3-4b37-8952-0f20c430f643 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:16.682734 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-66fdcc47-fdb3-4b37-8952-0f20c430f643 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:16.893340 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0f1b99d7-983f-486f-89f4-bf1187838a77 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:16.893968 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0f1b99d7-983f-486f-89f4-bf1187838a77 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:16.900766 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0f1b99d7-983f-486f-89f4-bf1187838a77 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:16.901211 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0f1b99d7-983f-486f-89f4-bf1187838a77 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:16.902028 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0f1b99d7-983f-486f-89f4-bf1187838a77 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:16.902468 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0f1b99d7-983f-486f-89f4-bf1187838a77 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:17.030841 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-66fdcc47-fdb3-4b37-8952-0f20c430f643 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c343e960fb4bbe8dda23a8c338c2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca740df033cb4ee7a6a42fe098749e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:17.039043 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-66fdcc47-fdb3-4b37-8952-0f20c430f643 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] 10.222.0.37 "GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd" status: 200 len: 1465 microversion: 2.1 time: 0.371076 Dec 27 14:23:17.039856 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 222/402] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:16 2021] GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd => generated 1465 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:17.044878 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-06aa2345-dfa8-4803-aa94-a57f45270793 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:17.045793 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-06aa2345-dfa8-4803-aa94-a57f45270793 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:17.052213 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-06aa2345-dfa8-4803-aa94-a57f45270793 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:17.052903 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-06aa2345-dfa8-4803-aa94-a57f45270793 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:17.053868 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-06aa2345-dfa8-4803-aa94-a57f45270793 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:17.054612 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-06aa2345-dfa8-4803-aa94-a57f45270793 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:17.072776 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0f1b99d7-983f-486f-89f4-bf1187838a77 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:17.083830 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0f1b99d7-983f-486f-89f4-bf1187838a77 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1521 microversion: 2.1 time: 0.194093 Dec 27 14:23:17.095222 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 181/403] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:16 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:17.100480 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-c6ea14f1-30f2-4070-b7c5-8aa4c11b93d7 req-1ffec0ab-5d2b-4c08-90db-b57e2f218b3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aad07b94-d83b-4d44-856c-80ac2e24b8b4", "tag": "d8953eb3-d364-4473-98c5-e33562dcd960"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:17.101603 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:23:17.101603 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:23:17.109949 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-c6ea14f1-30f2-4070-b7c5-8aa4c11b93d7 req-1ffec0ab-5d2b-4c08-90db-b57e2f218b3c service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:17.110441 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-c6ea14f1-30f2-4070-b7c5-8aa4c11b93d7 req-1ffec0ab-5d2b-4c08-90db-b57e2f218b3c service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:17.124327 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-c6ea14f1-30f2-4070-b7c5-8aa4c11b93d7 req-1ffec0ab-5d2b-4c08-90db-b57e2f218b3c service nova] Creating event network-changed:d8953eb3-d364-4473-98c5-e33562dcd960 for instance aad07b94-d83b-4d44-856c-80ac2e24b8b4 on hv-cinder-82301 Dec 27 14:23:17.131146 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-c6ea14f1-30f2-4070-b7c5-8aa4c11b93d7 req-1ffec0ab-5d2b-4c08-90db-b57e2f218b3c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034603 Dec 27 14:23:17.131883 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 182/404] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:23:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:23:17.137505 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d2d74aa8-dc5e-4723-818d-a10b0376c247 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:17.138119 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d2d74aa8-dc5e-4723-818d-a10b0376c247 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] [instance: e8d4102a-6cfc-442e-aa11-c1af898bfedd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:17.145378 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2d74aa8-dc5e-4723-818d-a10b0376c247 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:17.145836 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2d74aa8-dc5e-4723-818d-a10b0376c247 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:17.146642 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2d74aa8-dc5e-4723-818d-a10b0376c247 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:17.147078 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2d74aa8-dc5e-4723-818d-a10b0376c247 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:17.159790 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-06aa2345-dfa8-4803-aa94-a57f45270793 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 14 microversion: 2.20 time: 0.118273 Dec 27 14:23:17.163534 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 223/405] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:17 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:17.177457 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d2d74aa8-dc5e-4723-818d-a10b0376c247 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] [instance: e8d4102a-6cfc-442e-aa11-c1af898bfedd] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 27 14:23:17.218587 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-49aca771-b411-4458-9cec-c470ec44c4bd req-ee53da02-8f36-4886-a58e-e0716eda63d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0599d7cc-289a-4244-b9ad-0a46071fbd49", "name": "network-vif-plugged", "status": "completed", "tag": "de0c9b82-59fd-43d3-bf0a-a38ca864e6de"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:17.220287 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:23:17.220287 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:23:17.236645 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-49aca771-b411-4458-9cec-c470ec44c4bd req-ee53da02-8f36-4886-a58e-e0716eda63d5 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:17.237097 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-49aca771-b411-4458-9cec-c470ec44c4bd req-ee53da02-8f36-4886-a58e-e0716eda63d5 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:17.269988 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-49aca771-b411-4458-9cec-c470ec44c4bd req-ee53da02-8f36-4886-a58e-e0716eda63d5 service nova] Creating event network-vif-plugged:de0c9b82-59fd-43d3-bf0a-a38ca864e6de for instance 0599d7cc-289a-4244-b9ad-0a46071fbd49 on hv-cinder-82301 Dec 27 14:23:17.290668 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d2d74aa8-dc5e-4723-818d-a10b0376c247 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] 10.222.0.37 "DELETE /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd" status: 204 len: 0 microversion: 2.1 time: 0.155199 Dec 27 14:23:17.293166 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-49aca771-b411-4458-9cec-c470ec44c4bd req-ee53da02-8f36-4886-a58e-e0716eda63d5 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078921 Dec 27 14:23:17.293410 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 183/406] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Dec 27 14:23:17 2021] DELETE /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 27 14:23:17.294327 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 224/407] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:23:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:23:17.304779 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d4988864-7aa0-40fa-9ffa-4d6da695f45e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:17.305496 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d4988864-7aa0-40fa-9ffa-4d6da695f45e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:17.312096 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4988864-7aa0-40fa-9ffa-4d6da695f45e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:17.312552 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a7128e11-3d36-4b29-8f09-43eee1420bd9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:17.313203 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4988864-7aa0-40fa-9ffa-4d6da695f45e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:17.314207 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4988864-7aa0-40fa-9ffa-4d6da695f45e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:17.314641 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d4988864-7aa0-40fa-9ffa-4d6da695f45e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:17.315817 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a7128e11-3d36-4b29-8f09-43eee1420bd9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] [instance: e8d4102a-6cfc-442e-aa11-c1af898bfedd] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:17.336733 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a7128e11-3d36-4b29-8f09-43eee1420bd9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:17.337768 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a7128e11-3d36-4b29-8f09-43eee1420bd9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:17.338844 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a7128e11-3d36-4b29-8f09-43eee1420bd9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:17.340922 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a7128e11-3d36-4b29-8f09-43eee1420bd9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:17.506931 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d4988864-7aa0-40fa-9ffa-4d6da695f45e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:17.517147 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d4988864-7aa0-40fa-9ffa-4d6da695f45e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308" status: 200 len: 1319 microversion: 2.1 time: 0.220300 Dec 27 14:23:17.518355 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 184/408] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:17 2021] GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:17.527448 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-40291130-6e6a-422e-93a9-9850985f8b55 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:17.528767 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-40291130-6e6a-422e-93a9-9850985f8b55 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:17.537086 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-40291130-6e6a-422e-93a9-9850985f8b55 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:17.537905 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-40291130-6e6a-422e-93a9-9850985f8b55 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:17.539590 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-40291130-6e6a-422e-93a9-9850985f8b55 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:17.540443 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-40291130-6e6a-422e-93a9-9850985f8b55 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:17.650720 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a7128e11-3d36-4b29-8f09-43eee1420bd9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c343e960fb4bbe8dda23a8c338c2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca740df033cb4ee7a6a42fe098749e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:17.658425 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a7128e11-3d36-4b29-8f09-43eee1420bd9 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] 10.222.0.37 "GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd" status: 200 len: 1471 microversion: 2.1 time: 0.359361 Dec 27 14:23:17.659158 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 225/409] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:17 2021] GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd => generated 1471 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:17.672186 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4c703fb6-842f-4674-b3e9-770b40bef110 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:17.672830 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4c703fb6-842f-4674-b3e9-770b40bef110 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:17.678487 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4c703fb6-842f-4674-b3e9-770b40bef110 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:17.678953 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4c703fb6-842f-4674-b3e9-770b40bef110 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:17.679713 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4c703fb6-842f-4674-b3e9-770b40bef110 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:17.680174 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4c703fb6-842f-4674-b3e9-770b40bef110 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:17.839418 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4c703fb6-842f-4674-b3e9-770b40bef110 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:17.846851 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4c703fb6-842f-4674-b3e9-770b40bef110 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49" status: 200 len: 1318 microversion: 2.1 time: 0.186445 Dec 27 14:23:17.847429 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 226/410] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:17 2021] GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:17.923404 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-40291130-6e6a-422e-93a9-9850985f8b55 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.403610 Dec 27 14:23:17.924551 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 185/411] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:17 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:18.101156 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-522df080-73a3-4e07-9f12-a6baecfed824 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:18.101987 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-522df080-73a3-4e07-9f12-a6baecfed824 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:18.108798 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-522df080-73a3-4e07-9f12-a6baecfed824 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:18.109252 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-522df080-73a3-4e07-9f12-a6baecfed824 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:18.110090 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-522df080-73a3-4e07-9f12-a6baecfed824 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:18.110530 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-522df080-73a3-4e07-9f12-a6baecfed824 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:18.172059 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-20a972f3-3da2-436c-9448-a8d9894e34a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:18.173237 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-20a972f3-3da2-436c-9448-a8d9894e34a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:18.184018 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20a972f3-3da2-436c-9448-a8d9894e34a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:18.184678 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20a972f3-3da2-436c-9448-a8d9894e34a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:18.185476 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20a972f3-3da2-436c-9448-a8d9894e34a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:18.185907 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20a972f3-3da2-436c-9448-a8d9894e34a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:18.265493 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-20a972f3-3da2-436c-9448-a8d9894e34a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 14 microversion: 2.20 time: 0.097247 Dec 27 14:23:18.266313 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 186/412] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:18 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:18.307649 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-522df080-73a3-4e07-9f12-a6baecfed824 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:18.314966 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-522df080-73a3-4e07-9f12-a6baecfed824 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1521 microversion: 2.1 time: 0.217606 Dec 27 14:23:18.315532 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 227/413] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:18 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:18.535022 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a57ae070-6b9e-4843-a1d9-f1cd91ac4d50 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:18.535716 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a57ae070-6b9e-4843-a1d9-f1cd91ac4d50 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:18.543179 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a57ae070-6b9e-4843-a1d9-f1cd91ac4d50 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:18.543626 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a57ae070-6b9e-4843-a1d9-f1cd91ac4d50 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:18.544433 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a57ae070-6b9e-4843-a1d9-f1cd91ac4d50 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:18.544867 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a57ae070-6b9e-4843-a1d9-f1cd91ac4d50 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:18.673484 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a57ae070-6b9e-4843-a1d9-f1cd91ac4d50 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:18.675041 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-21f83ba1-9669-4b31-91c0-0a36939d1a49 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:18.675647 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-21f83ba1-9669-4b31-91c0-0a36939d1a49 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] [instance: e8d4102a-6cfc-442e-aa11-c1af898bfedd] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:18.682608 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-21f83ba1-9669-4b31-91c0-0a36939d1a49 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:18.682778 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a57ae070-6b9e-4843-a1d9-f1cd91ac4d50 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308" status: 200 len: 1319 microversion: 2.1 time: 0.151730 Dec 27 14:23:18.683051 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-21f83ba1-9669-4b31-91c0-0a36939d1a49 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:18.683279 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 187/414] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:18 2021] GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:18.683852 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-21f83ba1-9669-4b31-91c0-0a36939d1a49 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:18.684281 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-21f83ba1-9669-4b31-91c0-0a36939d1a49 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:18.813488 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-21f83ba1-9669-4b31-91c0-0a36939d1a49 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c343e960fb4bbe8dda23a8c338c2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca740df033cb4ee7a6a42fe098749e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:18.820650 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-21f83ba1-9669-4b31-91c0-0a36939d1a49 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] 10.222.0.37 "GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd" status: 200 len: 1471 microversion: 2.1 time: 0.149190 Dec 27 14:23:18.821213 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 228/415] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:18 2021] GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:18.864388 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4f6bf99d-8d57-4022-ba74-74f6ba4c76a5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:18.864997 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4f6bf99d-8d57-4022-ba74-74f6ba4c76a5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:18.871809 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4f6bf99d-8d57-4022-ba74-74f6ba4c76a5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:18.872285 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4f6bf99d-8d57-4022-ba74-74f6ba4c76a5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:18.873117 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4f6bf99d-8d57-4022-ba74-74f6ba4c76a5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:18.873498 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4f6bf99d-8d57-4022-ba74-74f6ba4c76a5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:18.935251 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fe04f3e8-5097-4518-93e9-7a01590e2908 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:18.936261 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fe04f3e8-5097-4518-93e9-7a01590e2908 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:18.942022 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe04f3e8-5097-4518-93e9-7a01590e2908 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:18.942501 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe04f3e8-5097-4518-93e9-7a01590e2908 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:18.943276 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe04f3e8-5097-4518-93e9-7a01590e2908 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:18.943711 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe04f3e8-5097-4518-93e9-7a01590e2908 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:19.003826 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4f6bf99d-8d57-4022-ba74-74f6ba4c76a5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:19.013334 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4f6bf99d-8d57-4022-ba74-74f6ba4c76a5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49" status: 200 len: 1318 microversion: 2.1 time: 0.152472 Dec 27 14:23:19.013920 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 188/416] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:18 2021] GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:19.081245 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fe04f3e8-5097-4518-93e9-7a01590e2908 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.149906 Dec 27 14:23:19.084071 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 229/417] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:18 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:23:19.276988 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fd3e9f0d-bd2f-4f6b-86a2-26f820db1913 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:19.277896 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fd3e9f0d-bd2f-4f6b-86a2-26f820db1913 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:19.284642 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd3e9f0d-bd2f-4f6b-86a2-26f820db1913 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:19.285084 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd3e9f0d-bd2f-4f6b-86a2-26f820db1913 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:19.285858 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd3e9f0d-bd2f-4f6b-86a2-26f820db1913 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:19.286290 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd3e9f0d-bd2f-4f6b-86a2-26f820db1913 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:19.331679 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e571ce60-ad8f-458c-b929-8fa52fa2ad7a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:19.332401 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e571ce60-ad8f-458c-b929-8fa52fa2ad7a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:19.340145 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e571ce60-ad8f-458c-b929-8fa52fa2ad7a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:19.340597 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e571ce60-ad8f-458c-b929-8fa52fa2ad7a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:19.341375 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e571ce60-ad8f-458c-b929-8fa52fa2ad7a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:19.341808 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e571ce60-ad8f-458c-b929-8fa52fa2ad7a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:19.389528 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fd3e9f0d-bd2f-4f6b-86a2-26f820db1913 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 14 microversion: 2.20 time: 0.116614 Dec 27 14:23:19.390754 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 189/418] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:19 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:19.474724 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e571ce60-ad8f-458c-b929-8fa52fa2ad7a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:19.482757 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e571ce60-ad8f-458c-b929-8fa52fa2ad7a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1521 microversion: 2.1 time: 0.155015 Dec 27 14:23:19.483535 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 230/419] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:19 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:19.701491 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d441ac31-721e-47c5-b727-2813cb16734e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:19.702212 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d441ac31-721e-47c5-b727-2813cb16734e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:19.710243 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d441ac31-721e-47c5-b727-2813cb16734e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:19.710875 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d441ac31-721e-47c5-b727-2813cb16734e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:19.711703 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d441ac31-721e-47c5-b727-2813cb16734e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:19.712165 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d441ac31-721e-47c5-b727-2813cb16734e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:19.838044 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-13881776-6e3e-497f-9827-f4d3c788cc84 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:19.838821 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-13881776-6e3e-497f-9827-f4d3c788cc84 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] [instance: e8d4102a-6cfc-442e-aa11-c1af898bfedd] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:19.845733 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-13881776-6e3e-497f-9827-f4d3c788cc84 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:19.845969 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d441ac31-721e-47c5-b727-2813cb16734e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:19.846180 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-13881776-6e3e-497f-9827-f4d3c788cc84 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:19.846965 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-13881776-6e3e-497f-9827-f4d3c788cc84 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:19.847421 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-13881776-6e3e-497f-9827-f4d3c788cc84 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:19.854023 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d441ac31-721e-47c5-b727-2813cb16734e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308" status: 200 len: 1319 microversion: 2.1 time: 0.156601 Dec 27 14:23:19.854593 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 190/420] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:19 2021] GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:19.976450 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-13881776-6e3e-497f-9827-f4d3c788cc84 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c343e960fb4bbe8dda23a8c338c2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca740df033cb4ee7a6a42fe098749e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:19.984613 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-13881776-6e3e-497f-9827-f4d3c788cc84 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] 10.222.0.37 "GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd" status: 200 len: 1471 microversion: 2.1 time: 0.150304 Dec 27 14:23:19.985182 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 231/421] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:19 2021] GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:20.030155 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4351141e-57fd-4396-9f64-6f2a20deeeca tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:20.030765 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4351141e-57fd-4396-9f64-6f2a20deeeca tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:20.037332 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4351141e-57fd-4396-9f64-6f2a20deeeca tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:20.037817 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4351141e-57fd-4396-9f64-6f2a20deeeca tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:20.038595 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4351141e-57fd-4396-9f64-6f2a20deeeca tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:20.039032 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4351141e-57fd-4396-9f64-6f2a20deeeca tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:20.093285 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-15d489f7-0344-43bd-9d83-413daba2870a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:20.094303 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-15d489f7-0344-43bd-9d83-413daba2870a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:20.100426 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-15d489f7-0344-43bd-9d83-413daba2870a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:20.100949 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-15d489f7-0344-43bd-9d83-413daba2870a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:20.101738 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-15d489f7-0344-43bd-9d83-413daba2870a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:20.102173 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-15d489f7-0344-43bd-9d83-413daba2870a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:20.174839 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4351141e-57fd-4396-9f64-6f2a20deeeca tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:20.186286 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4351141e-57fd-4396-9f64-6f2a20deeeca tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49" status: 200 len: 1508 microversion: 2.1 time: 0.159636 Dec 27 14:23:20.186861 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 191/422] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:20 2021] GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:20.199142 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-15d489f7-0344-43bd-9d83-413daba2870a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.109369 Dec 27 14:23:20.200057 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 232/423] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:20 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:23:20.400866 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b82dc85d-8210-4692-b967-dee103ee5b3d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:20.401795 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b82dc85d-8210-4692-b967-dee103ee5b3d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:20.408361 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b82dc85d-8210-4692-b967-dee103ee5b3d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:20.408822 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b82dc85d-8210-4692-b967-dee103ee5b3d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:20.410365 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b82dc85d-8210-4692-b967-dee103ee5b3d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:20.410836 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b82dc85d-8210-4692-b967-dee103ee5b3d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:20.507815 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1cad4c29-a695-4037-8eb9-552601c4d60f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:20.508543 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1cad4c29-a695-4037-8eb9-552601c4d60f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:20.516733 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1cad4c29-a695-4037-8eb9-552601c4d60f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:20.517305 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1cad4c29-a695-4037-8eb9-552601c4d60f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:20.518300 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1cad4c29-a695-4037-8eb9-552601c4d60f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:20.518875 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1cad4c29-a695-4037-8eb9-552601c4d60f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:20.628446 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b82dc85d-8210-4692-b967-dee103ee5b3d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 14 microversion: 2.20 time: 0.231128 Dec 27 14:23:20.631699 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 192/424] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:20 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 14 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:20.820957 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1cad4c29-a695-4037-8eb9-552601c4d60f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:20.829699 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1cad4c29-a695-4037-8eb9-552601c4d60f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1521 microversion: 2.1 time: 0.325794 Dec 27 14:23:20.832462 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 233/425] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:20 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:20.838014 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-4664104f-767e-4859-92b1-f55c2a6c076a req-e7d0cab2-04ad-483d-b88c-2807b2913e5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8d4102a-6cfc-442e-aa11-c1af898bfedd", "name": "network-vif-deleted", "tag": "93ed3518-1780-484d-ba95-946cdfd9103a"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:20.839775 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:23:20.839775 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:23:20.849266 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-4664104f-767e-4859-92b1-f55c2a6c076a req-e7d0cab2-04ad-483d-b88c-2807b2913e5b service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:20.849826 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-4664104f-767e-4859-92b1-f55c2a6c076a req-e7d0cab2-04ad-483d-b88c-2807b2913e5b service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:20.867704 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-4664104f-767e-4859-92b1-f55c2a6c076a req-e7d0cab2-04ad-483d-b88c-2807b2913e5b service nova] Creating event network-vif-deleted:93ed3518-1780-484d-ba95-946cdfd9103a for instance e8d4102a-6cfc-442e-aa11-c1af898bfedd on hv-cinder-82301 Dec 27 14:23:20.870811 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4e35344f-6290-4f51-9a6c-463c64c7525b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:20.872033 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4e35344f-6290-4f51-9a6c-463c64c7525b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:20.875965 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-4664104f-767e-4859-92b1-f55c2a6c076a req-e7d0cab2-04ad-483d-b88c-2807b2913e5b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042271 Dec 27 14:23:20.876574 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 193/426] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:23:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:23:20.881311 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4e35344f-6290-4f51-9a6c-463c64c7525b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:20.881873 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4e35344f-6290-4f51-9a6c-463c64c7525b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:20.882542 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4e35344f-6290-4f51-9a6c-463c64c7525b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:20.882976 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4e35344f-6290-4f51-9a6c-463c64c7525b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:21.002145 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6a77f139-52b5-4c76-ba46-e68594fccc9f tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:21.002741 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6a77f139-52b5-4c76-ba46-e68594fccc9f tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] [instance: e8d4102a-6cfc-442e-aa11-c1af898bfedd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:21.010571 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6a77f139-52b5-4c76-ba46-e68594fccc9f tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:21.011230 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6a77f139-52b5-4c76-ba46-e68594fccc9f tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:21.012063 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6a77f139-52b5-4c76-ba46-e68594fccc9f tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:21.012496 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6a77f139-52b5-4c76-ba46-e68594fccc9f tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:21.027707 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4e35344f-6290-4f51-9a6c-463c64c7525b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:21.035546 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4e35344f-6290-4f51-9a6c-463c64c7525b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308" status: 200 len: 1319 microversion: 2.1 time: 0.168952 Dec 27 14:23:21.036151 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 234/427] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:20 2021] GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:21.046919 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6a77f139-52b5-4c76-ba46-e68594fccc9f tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:21.047423 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6a77f139-52b5-4c76-ba46-e68594fccc9f tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:21.048435 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-6a77f139-52b5-4c76-ba46-e68594fccc9f tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lazy-loading 'fault' on Instance uuid e8d4102a-6cfc-442e-aa11-c1af898bfedd {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:23:21.096351 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6a77f139-52b5-4c76-ba46-e68594fccc9f tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c343e960fb4bbe8dda23a8c338c2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca740df033cb4ee7a6a42fe098749e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:21.104563 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6a77f139-52b5-4c76-ba46-e68594fccc9f tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] 10.222.0.37 "GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd" status: 200 len: 1305 microversion: 2.1 time: 0.106879 Dec 27 14:23:21.105133 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 194/428] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:20 2021] GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd => generated 1305 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:21.210491 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5ccf5ecd-2d38-4ecd-91dc-954c58940261 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:21.211609 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5ccf5ecd-2d38-4ecd-91dc-954c58940261 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:21.217984 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5ccf5ecd-2d38-4ecd-91dc-954c58940261 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:21.218639 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5ccf5ecd-2d38-4ecd-91dc-954c58940261 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:21.219422 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5ccf5ecd-2d38-4ecd-91dc-954c58940261 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:21.219910 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5ccf5ecd-2d38-4ecd-91dc-954c58940261 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:21.403194 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5ccf5ecd-2d38-4ecd-91dc-954c58940261 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.196133 Dec 27 14:23:21.403859 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 235/429] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:21 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:21.516212 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8f05ef92-3b74-4e82-96c1-11aa1b08685d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35d294b8-ccdd-480f-83c3-4b2cc5ec41f6"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:21.517281 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8f05ef92-3b74-4e82-96c1-11aa1b08685d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:21.526305 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8f05ef92-3b74-4e82-96c1-11aa1b08685d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:21.526761 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8f05ef92-3b74-4e82-96c1-11aa1b08685d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:21.527671 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8f05ef92-3b74-4e82-96c1-11aa1b08685d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:21.528215 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8f05ef92-3b74-4e82-96c1-11aa1b08685d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:21.639097 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d8418cb9-cb95-4296-b930-18f665f88d79 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:21.640172 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d8418cb9-cb95-4296-b930-18f665f88d79 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:21.646925 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8418cb9-cb95-4296-b930-18f665f88d79 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:21.647374 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8418cb9-cb95-4296-b930-18f665f88d79 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:21.648179 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8418cb9-cb95-4296-b930-18f665f88d79 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:21.648611 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8418cb9-cb95-4296-b930-18f665f88d79 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:21.899417 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d8418cb9-cb95-4296-b930-18f665f88d79 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 14 microversion: 2.20 time: 0.264086 Dec 27 14:23:21.902722 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 236/430] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:21 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 14 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:21.905263 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fdbd47cf-fbe1-4cb0-875c-98efd27553dd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:21.905946 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fdbd47cf-fbe1-4cb0-875c-98efd27553dd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:21.913198 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fdbd47cf-fbe1-4cb0-875c-98efd27553dd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:21.913879 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fdbd47cf-fbe1-4cb0-875c-98efd27553dd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:21.914828 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fdbd47cf-fbe1-4cb0-875c-98efd27553dd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:21.916118 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fdbd47cf-fbe1-4cb0-875c-98efd27553dd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:21.999414 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8f05ef92-3b74-4e82-96c1-11aa1b08685d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "POST /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.486732 Dec 27 14:23:22.000046 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 195/431] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Dec 27 14:23:21 2021] POST /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49/os-volume_attachments => generated 194 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:23:22.055670 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ccfa90ed-1a17-4d16-8519-09518935e216 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:22.055670 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ccfa90ed-1a17-4d16-8519-09518935e216 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:22.061161 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ccfa90ed-1a17-4d16-8519-09518935e216 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:22.061663 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ccfa90ed-1a17-4d16-8519-09518935e216 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:22.062455 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ccfa90ed-1a17-4d16-8519-09518935e216 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:22.062887 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ccfa90ed-1a17-4d16-8519-09518935e216 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:22.066831 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-fdbd47cf-fbe1-4cb0-875c-98efd27553dd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:22.075131 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fdbd47cf-fbe1-4cb0-875c-98efd27553dd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1521 microversion: 2.1 time: 0.173563 Dec 27 14:23:22.075936 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 237/432] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:21 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:22.121343 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b83c24e8-f2e7-4771-b08b-44b17e4ad6f3 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:22.121978 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b83c24e8-f2e7-4771-b08b-44b17e4ad6f3 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] [instance: e8d4102a-6cfc-442e-aa11-c1af898bfedd] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:22.128894 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b83c24e8-f2e7-4771-b08b-44b17e4ad6f3 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:22.129589 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b83c24e8-f2e7-4771-b08b-44b17e4ad6f3 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:22.130396 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b83c24e8-f2e7-4771-b08b-44b17e4ad6f3 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:22.130950 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b83c24e8-f2e7-4771-b08b-44b17e4ad6f3 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:22.163752 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b83c24e8-f2e7-4771-b08b-44b17e4ad6f3 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:22.164236 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b83c24e8-f2e7-4771-b08b-44b17e4ad6f3 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:22.164684 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.objects.instance [None req-b83c24e8-f2e7-4771-b08b-44b17e4ad6f3 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lazy-loading 'fault' on Instance uuid e8d4102a-6cfc-442e-aa11-c1af898bfedd {{(pid=116105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:23:22.205748 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b83c24e8-f2e7-4771-b08b-44b17e4ad6f3 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c343e960fb4bbe8dda23a8c338c2eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca740df033cb4ee7a6a42fe098749e01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:22.213749 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ccfa90ed-1a17-4d16-8519-09518935e216 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:22.213948 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b83c24e8-f2e7-4771-b08b-44b17e4ad6f3 tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] 10.222.0.37 "GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd" status: 200 len: 1305 microversion: 2.1 time: 0.096038 Dec 27 14:23:22.214546 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 238/433] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:22 2021] GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:22.221265 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ccfa90ed-1a17-4d16-8519-09518935e216 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308" status: 200 len: 1319 microversion: 2.1 time: 0.172160 Dec 27 14:23:22.222068 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 196/434] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:22 2021] GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:22.414586 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ce38887f-ca55-4b1c-bfd2-525dfd90d672 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:22.415429 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ce38887f-ca55-4b1c-bfd2-525dfd90d672 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:22.421285 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce38887f-ca55-4b1c-bfd2-525dfd90d672 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:22.421732 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce38887f-ca55-4b1c-bfd2-525dfd90d672 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:22.422499 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce38887f-ca55-4b1c-bfd2-525dfd90d672 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:22.422929 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce38887f-ca55-4b1c-bfd2-525dfd90d672 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:22.590903 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ce38887f-ca55-4b1c-bfd2-525dfd90d672 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.180005 Dec 27 14:23:22.591936 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 239/435] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:22 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:22.910487 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cd9c585e-a951-4fe3-854e-45f4d83776b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:22.911450 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cd9c585e-a951-4fe3-854e-45f4d83776b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:22.918680 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd9c585e-a951-4fe3-854e-45f4d83776b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:22.919106 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd9c585e-a951-4fe3-854e-45f4d83776b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:22.919894 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd9c585e-a951-4fe3-854e-45f4d83776b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:22.920334 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd9c585e-a951-4fe3-854e-45f4d83776b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:23.004730 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cd9c585e-a951-4fe3-854e-45f4d83776b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 14 microversion: 2.20 time: 0.097977 Dec 27 14:23:23.005563 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 197/436] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:22 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:23.093588 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ea2b98e9-8bd5-4bb9-aff9-1677700bfa8b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:23.094306 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ea2b98e9-8bd5-4bb9-aff9-1677700bfa8b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:23.102415 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ea2b98e9-8bd5-4bb9-aff9-1677700bfa8b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:23.103522 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ea2b98e9-8bd5-4bb9-aff9-1677700bfa8b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:23.104559 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ea2b98e9-8bd5-4bb9-aff9-1677700bfa8b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:23.105362 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ea2b98e9-8bd5-4bb9-aff9-1677700bfa8b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:23.210381 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-d04137cf-da7a-4051-bcb4-6d507777dd07 req-ac8d850d-4675-4022-bca5-966d7a0e8c88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77e5bc07-27af-405b-8aa6-c46ab71c6308", "name": "network-vif-plugged", "status": "completed", "tag": "b0dc9db5-833a-4012-9679-5e5a903f1834"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:23.212765 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:23:23.212765 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:23:23.221167 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-d04137cf-da7a-4051-bcb4-6d507777dd07 req-ac8d850d-4675-4022-bca5-966d7a0e8c88 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:23.221609 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-d04137cf-da7a-4051-bcb4-6d507777dd07 req-ac8d850d-4675-4022-bca5-966d7a0e8c88 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:23.237994 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-d04137cf-da7a-4051-bcb4-6d507777dd07 req-ac8d850d-4675-4022-bca5-966d7a0e8c88 service nova] Creating event network-vif-plugged:b0dc9db5-833a-4012-9679-5e5a903f1834 for instance 77e5bc07-27af-405b-8aa6-c46ab71c6308 on hv-cinder-82301 Dec 27 14:23:23.243366 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-d04137cf-da7a-4051-bcb4-6d507777dd07 req-ac8d850d-4675-4022-bca5-966d7a0e8c88 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036753 Dec 27 14:23:23.244869 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 198/437] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:23:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:23:23.250290 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b98f7d22-6a93-4fb2-bb32-14ce52bbabea tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:23.251249 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b98f7d22-6a93-4fb2-bb32-14ce52bbabea tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] [instance: e8d4102a-6cfc-442e-aa11-c1af898bfedd] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:23.258059 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b98f7d22-6a93-4fb2-bb32-14ce52bbabea tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:23.258795 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b98f7d22-6a93-4fb2-bb32-14ce52bbabea tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:23.259612 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b98f7d22-6a93-4fb2-bb32-14ce52bbabea tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:23.260098 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b98f7d22-6a93-4fb2-bb32-14ce52bbabea tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:23.275665 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-b98f7d22-6a93-4fb2-bb32-14ce52bbabea tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] HTTP exception thrown: Instance e8d4102a-6cfc-442e-aa11-c1af898bfedd could not be found. Dec 27 14:23:23.277037 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b98f7d22-6a93-4fb2-bb32-14ce52bbabea tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] Returning 404 to user: Instance e8d4102a-6cfc-442e-aa11-c1af898bfedd could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:23:23.278214 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b98f7d22-6a93-4fb2-bb32-14ce52bbabea tempest-VolumesNegativeTest-638244781 tempest-VolumesNegativeTest-638244781-project] 10.222.0.37 "GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd" status: 404 len: 111 microversion: 2.1 time: 0.031874 Dec 27 14:23:23.279356 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 199/438] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:23 2021] GET /compute/v2.1/servers/e8d4102a-6cfc-442e-aa11-c1af898bfedd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:23:23.287467 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e1ffefce-11d4-4258-a0e9-339f3cb763e8 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:23.288386 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e1ffefce-11d4-4258-a0e9-339f3cb763e8 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:23.297596 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1ffefce-11d4-4258-a0e9-339f3cb763e8 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:23.298290 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1ffefce-11d4-4258-a0e9-339f3cb763e8 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:23.299240 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1ffefce-11d4-4258-a0e9-339f3cb763e8 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:23.299828 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1ffefce-11d4-4258-a0e9-339f3cb763e8 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:23.355621 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ea2b98e9-8bd5-4bb9-aff9-1677700bfa8b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:23.367951 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ea2b98e9-8bd5-4bb9-aff9-1677700bfa8b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1521 microversion: 2.1 time: 0.279015 Dec 27 14:23:23.384004 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 240/439] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:23 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:23.506037 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e1ffefce-11d4-4258-a0e9-339f3cb763e8 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:23.517037 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e1ffefce-11d4-4258-a0e9-339f3cb763e8 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308" status: 200 len: 1319 microversion: 2.1 time: 0.234746 Dec 27 14:23:23.519879 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 200/440] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:23 2021] GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:23.603196 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c29c4993-56c0-4ebb-9365-4a28b4208546 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:23.604682 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c29c4993-56c0-4ebb-9365-4a28b4208546 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:23.637975 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c29c4993-56c0-4ebb-9365-4a28b4208546 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:23.638433 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c29c4993-56c0-4ebb-9365-4a28b4208546 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:23.639627 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c29c4993-56c0-4ebb-9365-4a28b4208546 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:23.640613 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c29c4993-56c0-4ebb-9365-4a28b4208546 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:23.802013 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d18d00ec-d463-4674-867d-6fbdb1c1e516 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:23.802819 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d18d00ec-d463-4674-867d-6fbdb1c1e516 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:23.810186 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d18d00ec-d463-4674-867d-6fbdb1c1e516 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:23.810633 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d18d00ec-d463-4674-867d-6fbdb1c1e516 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:23.811417 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d18d00ec-d463-4674-867d-6fbdb1c1e516 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:23.811888 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d18d00ec-d463-4674-867d-6fbdb1c1e516 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:23.963308 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d18d00ec-d463-4674-867d-6fbdb1c1e516 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:23.972398 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d18d00ec-d463-4674-867d-6fbdb1c1e516 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1595 microversion: 2.1 time: 0.173972 Dec 27 14:23:23.975870 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 201/441] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:23 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1595 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:24.016239 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6c2b5eff-8b11-4244-9102-320083db95d2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:24.017455 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6c2b5eff-8b11-4244-9102-320083db95d2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:24.028542 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c2b5eff-8b11-4244-9102-320083db95d2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:24.029202 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c2b5eff-8b11-4244-9102-320083db95d2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:24.030006 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c2b5eff-8b11-4244-9102-320083db95d2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:24.030817 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c2b5eff-8b11-4244-9102-320083db95d2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:24.085546 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c29c4993-56c0-4ebb-9365-4a28b4208546 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.486474 Dec 27 14:23:24.086370 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 241/442] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:23 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:24.137941 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6c2b5eff-8b11-4244-9102-320083db95d2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 14 microversion: 2.20 time: 0.125149 Dec 27 14:23:24.141351 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 202/443] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:24 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:24.390227 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-582b5e48-7ed8-4119-89bb-bf2ff8e5c04c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:24.391007 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-582b5e48-7ed8-4119-89bb-bf2ff8e5c04c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:24.398864 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-582b5e48-7ed8-4119-89bb-bf2ff8e5c04c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:24.399348 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-582b5e48-7ed8-4119-89bb-bf2ff8e5c04c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:24.400732 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-582b5e48-7ed8-4119-89bb-bf2ff8e5c04c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:24.401376 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-582b5e48-7ed8-4119-89bb-bf2ff8e5c04c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:24.535015 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2ba62da5-9203-4d37-94e0-29e5fef0b26b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:24.535987 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2ba62da5-9203-4d37-94e0-29e5fef0b26b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:24.544071 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2ba62da5-9203-4d37-94e0-29e5fef0b26b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:24.544608 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2ba62da5-9203-4d37-94e0-29e5fef0b26b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:24.545458 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2ba62da5-9203-4d37-94e0-29e5fef0b26b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:24.546138 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2ba62da5-9203-4d37-94e0-29e5fef0b26b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:24.635149 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-582b5e48-7ed8-4119-89bb-bf2ff8e5c04c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:24.649964 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-582b5e48-7ed8-4119-89bb-bf2ff8e5c04c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1501 microversion: 2.1 time: 0.263191 Dec 27 14:23:24.650778 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 242/444] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:24 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1501 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:24.668426 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-48b85b98-6925-49b1-9c8b-618ae3d534b7 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2083ed4b-1a21-462d-8f09-4b5ca9e3c7bc"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:24.669821 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-48b85b98-6925-49b1-9c8b-618ae3d534b7 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:24.676611 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-48b85b98-6925-49b1-9c8b-618ae3d534b7 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:24.677226 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-48b85b98-6925-49b1-9c8b-618ae3d534b7 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:24.678254 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-48b85b98-6925-49b1-9c8b-618ae3d534b7 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:24.678880 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-48b85b98-6925-49b1-9c8b-618ae3d534b7 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:24.697282 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2ba62da5-9203-4d37-94e0-29e5fef0b26b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:24.705247 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2ba62da5-9203-4d37-94e0-29e5fef0b26b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308" status: 200 len: 1319 microversion: 2.1 time: 0.174453 Dec 27 14:23:24.705731 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 203/445] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:24 2021] GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:24.708582 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-48b85b98-6925-49b1-9c8b-618ae3d534b7 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] HTTP exception thrown: Cannot 'attach_volume' instance 8520422d-f3a9-443c-9e9a-12fb03ef1bcc while it is in vm_state rescued Dec 27 14:23:24.709169 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-48b85b98-6925-49b1-9c8b-618ae3d534b7 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Returning 409 to user: Cannot 'attach_volume' instance 8520422d-f3a9-443c-9e9a-12fb03ef1bcc while it is in vm_state rescued {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:23:24.710050 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-48b85b98-6925-49b1-9c8b-618ae3d534b7 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "POST /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047080 Dec 27 14:23:24.710582 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 243/446] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Dec 27 14:23:24 2021] POST /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 27 14:23:24.720078 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-df44bb47-9714-483f-b293-05fdd12f355a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:24.720846 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-df44bb47-9714-483f-b293-05fdd12f355a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:24.729224 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df44bb47-9714-483f-b293-05fdd12f355a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:24.729670 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df44bb47-9714-483f-b293-05fdd12f355a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:24.730980 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df44bb47-9714-483f-b293-05fdd12f355a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:24.730980 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df44bb47-9714-483f-b293-05fdd12f355a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:24.816064 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-df44bb47-9714-483f-b293-05fdd12f355a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "POST /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc/action" status: 202 len: 0 microversion: 2.1 time: 0.099572 Dec 27 14:23:24.816628 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 204/447] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:24 2021] POST /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:23:24.825555 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8df00a30-6c49-4ea5-8a03-7865a8dae348 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:24.826571 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8df00a30-6c49-4ea5-8a03-7865a8dae348 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:24.833010 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8df00a30-6c49-4ea5-8a03-7865a8dae348 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:24.833773 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8df00a30-6c49-4ea5-8a03-7865a8dae348 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:24.834852 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8df00a30-6c49-4ea5-8a03-7865a8dae348 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:24.835395 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8df00a30-6c49-4ea5-8a03-7865a8dae348 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:25.098733 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-42291366-f27e-4431-962a-a252d2563462 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:25.099742 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-42291366-f27e-4431-962a-a252d2563462 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:25.109742 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42291366-f27e-4431-962a-a252d2563462 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:25.110367 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42291366-f27e-4431-962a-a252d2563462 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:25.111206 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42291366-f27e-4431-962a-a252d2563462 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:25.111675 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-42291366-f27e-4431-962a-a252d2563462 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:25.194721 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-42291366-f27e-4431-962a-a252d2563462 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.099902 Dec 27 14:23:25.197578 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 205/448] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:25 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:23:25.203069 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ca61b523-e7f1-4fb8-9807-e7569bc9cffe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:25.204106 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ca61b523-e7f1-4fb8-9807-e7569bc9cffe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:25.215443 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca61b523-e7f1-4fb8-9807-e7569bc9cffe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:25.215536 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca61b523-e7f1-4fb8-9807-e7569bc9cffe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:25.216349 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca61b523-e7f1-4fb8-9807-e7569bc9cffe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:25.216785 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca61b523-e7f1-4fb8-9807-e7569bc9cffe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:25.317050 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ca61b523-e7f1-4fb8-9807-e7569bc9cffe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 14 microversion: 2.20 time: 0.118053 Dec 27 14:23:25.317796 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 206/449] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:25 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:25.511578 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8df00a30-6c49-4ea5-8a03-7865a8dae348 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:25.520216 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8df00a30-6c49-4ea5-8a03-7865a8dae348 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1509 microversion: 2.1 time: 0.699227 Dec 27 14:23:25.520863 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 244/450] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:24 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1509 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:25.723322 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a6f57b94-773b-4267-aa1e-51bd1f611fb7 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:25.724331 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a6f57b94-773b-4267-aa1e-51bd1f611fb7 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:25.739965 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a6f57b94-773b-4267-aa1e-51bd1f611fb7 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:25.740911 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a6f57b94-773b-4267-aa1e-51bd1f611fb7 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:25.748229 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a6f57b94-773b-4267-aa1e-51bd1f611fb7 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:25.748229 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a6f57b94-773b-4267-aa1e-51bd1f611fb7 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:25.905839 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a6f57b94-773b-4267-aa1e-51bd1f611fb7 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:25.916629 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a6f57b94-773b-4267-aa1e-51bd1f611fb7 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308" status: 200 len: 1319 microversion: 2.1 time: 0.197330 Dec 27 14:23:25.917431 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 207/451] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:25 2021] GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:26.206436 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b71fa227-6019-4f14-9495-cd69736225ef tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:26.207379 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b71fa227-6019-4f14-9495-cd69736225ef tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:26.216978 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b71fa227-6019-4f14-9495-cd69736225ef tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:26.217434 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b71fa227-6019-4f14-9495-cd69736225ef tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:26.218244 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b71fa227-6019-4f14-9495-cd69736225ef tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:26.218673 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b71fa227-6019-4f14-9495-cd69736225ef tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:26.312580 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b71fa227-6019-4f14-9495-cd69736225ef tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.109528 Dec 27 14:23:26.313381 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 245/452] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:26 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:23:26.328547 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1b790c5d-dce4-47bb-89d5-db65469b5310 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:26.329664 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1b790c5d-dce4-47bb-89d5-db65469b5310 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:26.336174 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b790c5d-dce4-47bb-89d5-db65469b5310 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:26.337007 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b790c5d-dce4-47bb-89d5-db65469b5310 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:26.337980 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b790c5d-dce4-47bb-89d5-db65469b5310 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:26.338475 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b790c5d-dce4-47bb-89d5-db65469b5310 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:26.484144 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1b790c5d-dce4-47bb-89d5-db65469b5310 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 14 microversion: 2.20 time: 0.159393 Dec 27 14:23:26.484788 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 208/453] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:26 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:26.539409 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-dcb2d795-5cd8-47ce-80bb-3b1ed3055a52 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:26.540471 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-dcb2d795-5cd8-47ce-80bb-3b1ed3055a52 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:26.547310 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dcb2d795-5cd8-47ce-80bb-3b1ed3055a52 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:26.547855 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dcb2d795-5cd8-47ce-80bb-3b1ed3055a52 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:26.548797 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dcb2d795-5cd8-47ce-80bb-3b1ed3055a52 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:26.549335 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dcb2d795-5cd8-47ce-80bb-3b1ed3055a52 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:26.764351 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-dcb2d795-5cd8-47ce-80bb-3b1ed3055a52 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:26.774128 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-dcb2d795-5cd8-47ce-80bb-3b1ed3055a52 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1509 microversion: 2.1 time: 0.238844 Dec 27 14:23:26.776038 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 246/454] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:26 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1509 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:26.778679 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-62a64c98-6bf7-44ea-b978-7fd85e121b51 req-4c0e1f32-cb03-4a70-95ae-4266b577f18c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ff5786-5d44-438e-bb0a-f3fd05d83e40", "tag": "7e953f6b-a948-41fc-94f1-b04996e676ac"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:26.780295 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:23:26.780295 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:23:26.789363 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-62a64c98-6bf7-44ea-b978-7fd85e121b51 req-4c0e1f32-cb03-4a70-95ae-4266b577f18c service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:26.789714 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-62a64c98-6bf7-44ea-b978-7fd85e121b51 req-4c0e1f32-cb03-4a70-95ae-4266b577f18c service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:26.803560 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-62a64c98-6bf7-44ea-b978-7fd85e121b51 req-4c0e1f32-cb03-4a70-95ae-4266b577f18c service nova] Creating event network-changed:7e953f6b-a948-41fc-94f1-b04996e676ac for instance 29ff5786-5d44-438e-bb0a-f3fd05d83e40 on hv-cinder-82301 Dec 27 14:23:26.809601 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-62a64c98-6bf7-44ea-b978-7fd85e121b51 req-4c0e1f32-cb03-4a70-95ae-4266b577f18c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037442 Dec 27 14:23:26.810419 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 209/455] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:23:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:23:26.934476 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8c7e3ff9-3c43-4966-b4cd-a325eabe8e39 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:26.935262 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8c7e3ff9-3c43-4966-b4cd-a325eabe8e39 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:26.941974 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8c7e3ff9-3c43-4966-b4cd-a325eabe8e39 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:26.943314 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8c7e3ff9-3c43-4966-b4cd-a325eabe8e39 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:26.945184 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8c7e3ff9-3c43-4966-b4cd-a325eabe8e39 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:26.946878 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8c7e3ff9-3c43-4966-b4cd-a325eabe8e39 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:27.182674 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8c7e3ff9-3c43-4966-b4cd-a325eabe8e39 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:27.192295 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8c7e3ff9-3c43-4966-b4cd-a325eabe8e39 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308" status: 200 len: 1508 microversion: 2.1 time: 0.262344 Dec 27 14:23:27.193001 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 247/456] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:26 2021] GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308 => generated 1508 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:27.325909 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9ebeeb38-f19f-4206-b3e3-46eb9c8d1a4e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:27.326798 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9ebeeb38-f19f-4206-b3e3-46eb9c8d1a4e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:27.342732 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ebeeb38-f19f-4206-b3e3-46eb9c8d1a4e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:27.360272 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ebeeb38-f19f-4206-b3e3-46eb9c8d1a4e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:27.365054 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ebeeb38-f19f-4206-b3e3-46eb9c8d1a4e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:27.366512 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ebeeb38-f19f-4206-b3e3-46eb9c8d1a4e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:27.487671 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9ebeeb38-f19f-4206-b3e3-46eb9c8d1a4e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.165294 Dec 27 14:23:27.496780 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9a90bec2-c26c-452f-9f8d-e1651449d9fd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:27.500799 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 210/457] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:27 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:27.500910 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9a90bec2-c26c-452f-9f8d-e1651449d9fd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:27.507596 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a90bec2-c26c-452f-9f8d-e1651449d9fd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:27.508302 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a90bec2-c26c-452f-9f8d-e1651449d9fd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:27.510142 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a90bec2-c26c-452f-9f8d-e1651449d9fd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:27.510856 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a90bec2-c26c-452f-9f8d-e1651449d9fd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:27.593987 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9a90bec2-c26c-452f-9f8d-e1651449d9fd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 14 microversion: 2.20 time: 0.102660 Dec 27 14:23:27.595280 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 248/458] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:27 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:27.792990 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-aa30d032-d858-417e-9b3b-dd038a87acfd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:27.793689 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-aa30d032-d858-417e-9b3b-dd038a87acfd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:27.807071 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aa30d032-d858-417e-9b3b-dd038a87acfd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:27.807584 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aa30d032-d858-417e-9b3b-dd038a87acfd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:27.810134 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aa30d032-d858-417e-9b3b-dd038a87acfd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:27.810674 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aa30d032-d858-417e-9b3b-dd038a87acfd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:27.984916 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-aa30d032-d858-417e-9b3b-dd038a87acfd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:27.995200 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-aa30d032-d858-417e-9b3b-dd038a87acfd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1509 microversion: 2.1 time: 0.206634 Dec 27 14:23:28.006206 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 211/459] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:27 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1509 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:28.201083 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9ece6ad5-794e-444d-ae60-b1e43e6d7399 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1627542527"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:28.202008 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9ece6ad5-794e-444d-ae60-b1e43e6d7399 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:28.209480 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ece6ad5-794e-444d-ae60-b1e43e6d7399 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:28.210105 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ece6ad5-794e-444d-ae60-b1e43e6d7399 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:28.211045 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ece6ad5-794e-444d-ae60-b1e43e6d7399 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:28.212654 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ece6ad5-794e-444d-ae60-b1e43e6d7399 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:28.508131 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dc6d6f50-c299-4da3-abf9-c796b833d2dd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:28.510271 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dc6d6f50-c299-4da3-abf9-c796b833d2dd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:28.517916 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc6d6f50-c299-4da3-abf9-c796b833d2dd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:28.518367 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc6d6f50-c299-4da3-abf9-c796b833d2dd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:28.519196 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc6d6f50-c299-4da3-abf9-c796b833d2dd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:28.519627 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc6d6f50-c299-4da3-abf9-c796b833d2dd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:28.599973 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dc6d6f50-c299-4da3-abf9-c796b833d2dd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.094844 Dec 27 14:23:28.601091 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 212/460] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:28 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:28.607407 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-936cbdae-bc32-493c-8a43-295e603e64ef tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:28.608463 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-936cbdae-bc32-493c-8a43-295e603e64ef tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:28.615459 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-936cbdae-bc32-493c-8a43-295e603e64ef tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:28.615943 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-936cbdae-bc32-493c-8a43-295e603e64ef tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:28.616736 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-936cbdae-bc32-493c-8a43-295e603e64ef tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:28.617170 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-936cbdae-bc32-493c-8a43-295e603e64ef tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:28.640675 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.network.security_group_api [None req-9ece6ad5-794e-444d-ae60-b1e43e6d7399 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Adding security group ae997008-005f-48b5-9677-e7995653da8a to port 7e953f6b-a948-41fc-94f1-b04996e676ac Dec 27 14:23:28.700959 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-936cbdae-bc32-493c-8a43-295e603e64ef tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 14 microversion: 2.20 time: 0.098222 Dec 27 14:23:28.701590 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 213/461] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:28 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:28.988866 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9ece6ad5-794e-444d-ae60-b1e43e6d7399 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "POST /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40/action" status: 202 len: 0 microversion: 2.1 time: 0.794765 Dec 27 14:23:28.990014 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 249/462] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:28 2021] POST /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40/action => generated 0 bytes in 797 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:23:29.001626 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-495f7359-5489-4ad3-932f-c692659f6d84 req-013bf7bb-2b64-46c8-9fef-e091331210b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ff5786-5d44-438e-bb0a-f3fd05d83e40", "tag": "7e953f6b-a948-41fc-94f1-b04996e676ac"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:29.004385 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-693ed337-aef3-4a54-8553-4c2ca0ba198b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:29.005650 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-693ed337-aef3-4a54-8553-4c2ca0ba198b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:29.007532 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:23:29.007532 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:23:29.021116 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-693ed337-aef3-4a54-8553-4c2ca0ba198b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:29.023504 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-495f7359-5489-4ad3-932f-c692659f6d84 req-013bf7bb-2b64-46c8-9fef-e091331210b4 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:29.024920 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-693ed337-aef3-4a54-8553-4c2ca0ba198b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:29.025678 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-495f7359-5489-4ad3-932f-c692659f6d84 req-013bf7bb-2b64-46c8-9fef-e091331210b4 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:29.026683 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-693ed337-aef3-4a54-8553-4c2ca0ba198b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:29.030117 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-693ed337-aef3-4a54-8553-4c2ca0ba198b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:29.045438 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-495f7359-5489-4ad3-932f-c692659f6d84 req-013bf7bb-2b64-46c8-9fef-e091331210b4 service nova] Creating event network-changed:7e953f6b-a948-41fc-94f1-b04996e676ac for instance 29ff5786-5d44-438e-bb0a-f3fd05d83e40 on hv-cinder-82301 Dec 27 14:23:29.061953 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-495f7359-5489-4ad3-932f-c692659f6d84 req-013bf7bb-2b64-46c8-9fef-e091331210b4 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065236 Dec 27 14:23:29.062875 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 250/463] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:23:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:23:29.070619 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1c14425c-0c98-45ba-8b93-552b38b97c15 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:29.071377 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1c14425c-0c98-45ba-8b93-552b38b97c15 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:29.084937 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1c14425c-0c98-45ba-8b93-552b38b97c15 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:29.085539 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1c14425c-0c98-45ba-8b93-552b38b97c15 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:29.088693 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1c14425c-0c98-45ba-8b93-552b38b97c15 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:29.089260 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1c14425c-0c98-45ba-8b93-552b38b97c15 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:29.237329 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-693ed337-aef3-4a54-8553-4c2ca0ba198b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:29.249082 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-693ed337-aef3-4a54-8553-4c2ca0ba198b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1761 microversion: 2.1 time: 0.253664 Dec 27 14:23:29.250285 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 214/464] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:28 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1761 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:29.370187 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1c14425c-0c98-45ba-8b93-552b38b97c15 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:29.378514 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1c14425c-0c98-45ba-8b93-552b38b97c15 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1509 microversion: 2.1 time: 0.314460 Dec 27 14:23:29.379360 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 251/465] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:29 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1509 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:29.614036 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-eee179e2-31e8-4d75-bd83-7456badf2eeb tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:29.618072 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-eee179e2-31e8-4d75-bd83-7456badf2eeb tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:29.628187 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eee179e2-31e8-4d75-bd83-7456badf2eeb tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:29.628781 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eee179e2-31e8-4d75-bd83-7456badf2eeb tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:29.629655 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eee179e2-31e8-4d75-bd83-7456badf2eeb tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:29.630286 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eee179e2-31e8-4d75-bd83-7456badf2eeb tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:29.711676 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-26195cef-227a-45c2-ba99-62da6036cca1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:29.713461 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-26195cef-227a-45c2-ba99-62da6036cca1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:29.719410 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-26195cef-227a-45c2-ba99-62da6036cca1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:29.719967 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-26195cef-227a-45c2-ba99-62da6036cca1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:29.720838 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-26195cef-227a-45c2-ba99-62da6036cca1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:29.721310 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-26195cef-227a-45c2-ba99-62da6036cca1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:29.782127 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-eee179e2-31e8-4d75-bd83-7456badf2eeb tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.171421 Dec 27 14:23:29.783132 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 215/466] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:29 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:29.801371 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-26195cef-227a-45c2-ba99-62da6036cca1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 14 microversion: 2.20 time: 0.093198 Dec 27 14:23:29.802011 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 252/467] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:29 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:30.397055 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5075298c-5aec-4d35-a7bc-e5399787ebe1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:30.397665 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5075298c-5aec-4d35-a7bc-e5399787ebe1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:30.404932 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5075298c-5aec-4d35-a7bc-e5399787ebe1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:30.405386 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5075298c-5aec-4d35-a7bc-e5399787ebe1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:30.406435 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5075298c-5aec-4d35-a7bc-e5399787ebe1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:30.407104 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5075298c-5aec-4d35-a7bc-e5399787ebe1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:30.546237 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5075298c-5aec-4d35-a7bc-e5399787ebe1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:30.553425 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5075298c-5aec-4d35-a7bc-e5399787ebe1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1515 microversion: 2.1 time: 0.160498 Dec 27 14:23:30.553984 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 216/468] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:30 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:30.796835 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-87d5424e-14fb-4df4-9afa-3c0472ecbeb5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:30.799347 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-87d5424e-14fb-4df4-9afa-3c0472ecbeb5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:30.810915 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-87d5424e-14fb-4df4-9afa-3c0472ecbeb5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:30.811590 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-87d5424e-14fb-4df4-9afa-3c0472ecbeb5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:30.812916 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-87d5424e-14fb-4df4-9afa-3c0472ecbeb5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:30.813397 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-87d5424e-14fb-4df4-9afa-3c0472ecbeb5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:30.813519 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-21d13c60-4080-459f-ade3-f999773a26e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:30.814325 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-21d13c60-4080-459f-ade3-f999773a26e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:30.832369 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21d13c60-4080-459f-ade3-f999773a26e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:30.833070 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21d13c60-4080-459f-ade3-f999773a26e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:30.833883 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21d13c60-4080-459f-ade3-f999773a26e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:30.834312 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21d13c60-4080-459f-ade3-f999773a26e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:30.917056 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-87d5424e-14fb-4df4-9afa-3c0472ecbeb5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.124163 Dec 27 14:23:30.918035 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 253/469] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:30 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:30.936534 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-21d13c60-4080-459f-ade3-f999773a26e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 14 microversion: 2.20 time: 0.127280 Dec 27 14:23:30.937262 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 217/470] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:30 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:31.734978 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e76d3576-5251-49c3-ba16-93e61c5c78fc tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35d294b8-ccdd-480f-83c3-4b2cc5ec41f6"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:31.736266 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e76d3576-5251-49c3-ba16-93e61c5c78fc tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:31.743097 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e76d3576-5251-49c3-ba16-93e61c5c78fc tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:31.743501 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e76d3576-5251-49c3-ba16-93e61c5c78fc tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:31.744264 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e76d3576-5251-49c3-ba16-93e61c5c78fc tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:31.744692 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e76d3576-5251-49c3-ba16-93e61c5c78fc tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:31.824511 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-e76d3576-5251-49c3-ba16-93e61c5c78fc tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] HTTP exception thrown: Invalid volume: volume 35d294b8-ccdd-480f-83c3-4b2cc5ec41f6 is already attached to instances: 0599d7cc-289a-4244-b9ad-0a46071fbd49 Dec 27 14:23:31.825105 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e76d3576-5251-49c3-ba16-93e61c5c78fc tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Returning 400 to user: Invalid volume: volume 35d294b8-ccdd-480f-83c3-4b2cc5ec41f6 is already attached to instances: 0599d7cc-289a-4244-b9ad-0a46071fbd49 {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:23:31.825926 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e76d3576-5251-49c3-ba16-93e61c5c78fc tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "POST /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095202 Dec 27 14:23:31.826478 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 254/471] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Dec 27 14:23:31 2021] POST /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 27 14:23:31.887998 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1bb10a4e-3feb-4682-a249-8d52e6422a24 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:31.888580 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1bb10a4e-3feb-4682-a249-8d52e6422a24 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:31.895575 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1bb10a4e-3feb-4682-a249-8d52e6422a24 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:31.896099 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1bb10a4e-3feb-4682-a249-8d52e6422a24 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:31.896902 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1bb10a4e-3feb-4682-a249-8d52e6422a24 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:31.897335 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1bb10a4e-3feb-4682-a249-8d52e6422a24 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:31.933940 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-dc526f4a-4bbd-4018-b5c2-f15d6b0fc526 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:31.935044 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-dc526f4a-4bbd-4018-b5c2-f15d6b0fc526 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:31.944191 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dc526f4a-4bbd-4018-b5c2-f15d6b0fc526 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:31.944651 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dc526f4a-4bbd-4018-b5c2-f15d6b0fc526 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:31.945453 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dc526f4a-4bbd-4018-b5c2-f15d6b0fc526 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:31.946386 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dc526f4a-4bbd-4018-b5c2-f15d6b0fc526 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:31.984022 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-1bb10a4e-3feb-4682-a249-8d52e6422a24 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lazy-loading 'services' on Instance uuid 0599d7cc-289a-4244-b9ad-0a46071fbd49 {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:23:32.026426 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-dc526f4a-4bbd-4018-b5c2-f15d6b0fc526 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.101084 Dec 27 14:23:32.027082 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 255/472] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:31 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:32.032855 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6b21f808-ed92-4590-aca5-3cc3e3a6f3b9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:32.033897 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6b21f808-ed92-4590-aca5-3cc3e3a6f3b9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:32.041081 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6b21f808-ed92-4590-aca5-3cc3e3a6f3b9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:32.041534 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6b21f808-ed92-4590-aca5-3cc3e3a6f3b9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:32.042333 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6b21f808-ed92-4590-aca5-3cc3e3a6f3b9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:32.042820 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6b21f808-ed92-4590-aca5-3cc3e3a6f3b9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:32.068414 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1bb10a4e-3feb-4682-a249-8d52e6422a24 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "DELETE /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49/os-volume_attachments/35d294b8-ccdd-480f-83c3-4b2cc5ec41f6" status: 202 len: 0 microversion: 2.1 time: 0.185706 Dec 27 14:23:32.069858 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 218/473] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Dec 27 14:23:31 2021] DELETE /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49/os-volume_attachments/35d294b8-ccdd-480f-83c3-4b2cc5ec41f6 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:23:32.091305 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ec90f5d5-20a1-4a7f-b769-6174fb38075f tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:32.092675 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ec90f5d5-20a1-4a7f-b769-6174fb38075f tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:32.099155 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ec90f5d5-20a1-4a7f-b769-6174fb38075f tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:32.099602 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ec90f5d5-20a1-4a7f-b769-6174fb38075f tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:32.100420 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ec90f5d5-20a1-4a7f-b769-6174fb38075f tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:32.100852 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ec90f5d5-20a1-4a7f-b769-6174fb38075f tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:32.131851 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ec90f5d5-20a1-4a7f-b769-6174fb38075f tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049592 Dec 27 14:23:32.132873 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 219/474] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:23:32 2021] GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:23:32.168510 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6b21f808-ed92-4590-aca5-3cc3e3a6f3b9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 14 microversion: 2.20 time: 0.139984 Dec 27 14:23:32.169128 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 256/475] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:32 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:32.927528 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c1589ba0-8bba-4254-b957-0d836c561dfb tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:32.928173 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c1589ba0-8bba-4254-b957-0d836c561dfb tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:32.934875 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1589ba0-8bba-4254-b957-0d836c561dfb tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:32.935566 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1589ba0-8bba-4254-b957-0d836c561dfb tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:32.936609 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1589ba0-8bba-4254-b957-0d836c561dfb tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:32.937093 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1589ba0-8bba-4254-b957-0d836c561dfb tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:33.073987 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c1589ba0-8bba-4254-b957-0d836c561dfb tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:33.081345 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c1589ba0-8bba-4254-b957-0d836c561dfb tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1515 microversion: 2.1 time: 0.157415 Dec 27 14:23:33.081899 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 220/476] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:32 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:33.089372 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6faf9bbd-512f-4b29-84c5-bf99b378d0e7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:33.090445 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6faf9bbd-512f-4b29-84c5-bf99b378d0e7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:33.097202 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1e79209c-ec7e-4945-85c1-a071b3cd2d2b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acf226b1-5b42-4677-bbe8-cacf6eef4cfc"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:33.097473 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6faf9bbd-512f-4b29-84c5-bf99b378d0e7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:33.097983 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6faf9bbd-512f-4b29-84c5-bf99b378d0e7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:33.098248 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1e79209c-ec7e-4945-85c1-a071b3cd2d2b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:33.098883 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6faf9bbd-512f-4b29-84c5-bf99b378d0e7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:33.099383 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6faf9bbd-512f-4b29-84c5-bf99b378d0e7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:33.104468 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e79209c-ec7e-4945-85c1-a071b3cd2d2b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:33.104919 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e79209c-ec7e-4945-85c1-a071b3cd2d2b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:33.105707 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e79209c-ec7e-4945-85c1-a071b3cd2d2b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:33.106146 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e79209c-ec7e-4945-85c1-a071b3cd2d2b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:33.210678 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6faf9bbd-512f-4b29-84c5-bf99b378d0e7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.125047 Dec 27 14:23:33.211316 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 257/477] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:33 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:23:33.216649 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1b355ad0-317f-4b53-b4f3-5b821cbcafc0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:33.217627 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1b355ad0-317f-4b53-b4f3-5b821cbcafc0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:33.225337 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1b355ad0-317f-4b53-b4f3-5b821cbcafc0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:33.225825 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1b355ad0-317f-4b53-b4f3-5b821cbcafc0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:33.226953 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1b355ad0-317f-4b53-b4f3-5b821cbcafc0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:33.227946 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1b355ad0-317f-4b53-b4f3-5b821cbcafc0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:33.263942 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1b355ad0-317f-4b53-b4f3-5b821cbcafc0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051028 Dec 27 14:23:33.264827 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 258/478] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:23:33 2021] GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:23:33.272834 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6744819b-f901-4546-9ce3-9c7ebfd0b697 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:33.274123 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6744819b-f901-4546-9ce3-9c7ebfd0b697 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:33.283134 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6744819b-f901-4546-9ce3-9c7ebfd0b697 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:33.283745 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6744819b-f901-4546-9ce3-9c7ebfd0b697 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:33.284579 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6744819b-f901-4546-9ce3-9c7ebfd0b697 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:33.285192 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6744819b-f901-4546-9ce3-9c7ebfd0b697 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:33.368421 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6744819b-f901-4546-9ce3-9c7ebfd0b697 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 14 microversion: 2.20 time: 0.098482 Dec 27 14:23:33.369095 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 259/479] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:33 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:33.392294 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1e79209c-ec7e-4945-85c1-a071b3cd2d2b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "POST /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298488 Dec 27 14:23:33.392853 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 221/480] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Dec 27 14:23:33 2021] POST /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:23:34.222596 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-24e10210-6b53-4e37-a1ea-42775bbae765 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:34.223634 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-24e10210-6b53-4e37-a1ea-42775bbae765 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:34.231160 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24e10210-6b53-4e37-a1ea-42775bbae765 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:34.231609 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24e10210-6b53-4e37-a1ea-42775bbae765 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:34.232417 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24e10210-6b53-4e37-a1ea-42775bbae765 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:34.232851 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24e10210-6b53-4e37-a1ea-42775bbae765 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:34.277075 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f5e8427b-0114-452d-a29f-adaed22b5989 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:34.278127 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f5e8427b-0114-452d-a29f-adaed22b5989 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:34.284580 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5e8427b-0114-452d-a29f-adaed22b5989 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:34.285032 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5e8427b-0114-452d-a29f-adaed22b5989 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:34.285809 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5e8427b-0114-452d-a29f-adaed22b5989 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:34.286244 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5e8427b-0114-452d-a29f-adaed22b5989 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:34.316824 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f5e8427b-0114-452d-a29f-adaed22b5989 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045022 Dec 27 14:23:34.317379 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 222/481] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:23:34 2021] GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 27 14:23:34.337698 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-24e10210-6b53-4e37-a1ea-42775bbae765 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.118155 Dec 27 14:23:34.339232 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 260/482] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:34 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:34.380191 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4e4bef82-ce86-4dd7-94cb-f6194cb91ff3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:34.381155 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4e4bef82-ce86-4dd7-94cb-f6194cb91ff3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:34.387650 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4e4bef82-ce86-4dd7-94cb-f6194cb91ff3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:34.388132 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4e4bef82-ce86-4dd7-94cb-f6194cb91ff3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:34.388944 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4e4bef82-ce86-4dd7-94cb-f6194cb91ff3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:34.389363 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4e4bef82-ce86-4dd7-94cb-f6194cb91ff3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:34.470384 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-76424d81-4f60-45a3-a906-98963f6e2d08 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-726208715", "imageRef": "c8bd383f-96c5-4e2b-aaa5-fabd68b307f6", "flavorRef": "452", "networks": [{"uuid": "f572a130-3f83-4c3c-b51f-af2b9bc79a2e"}]}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:34.514033 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4e4bef82-ce86-4dd7-94cb-f6194cb91ff3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 2431 microversion: 2.20 time: 0.138098 Dec 27 14:23:34.514661 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 223/483] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:34 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 2431 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:23:34.526122 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.network.neutron [None req-76424d81-4f60-45a3-a906-98963f6e2d08 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] validate_networks() for [('f572a130-3f83-4c3c-b51f-af2b9bc79a2e', None, None, None, None, None)] {{(pid=116105) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 27 14:23:34.904519 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-76424d81-4f60-45a3-a906-98963f6e2d08 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Flavor limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 27 14:23:34.904934 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-76424d81-4f60-45a3-a906-98963f6e2d08 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Image limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 27 14:23:34.905396 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-76424d81-4f60-45a3-a906-98963f6e2d08 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Flavor pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 27 14:23:34.905796 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-76424d81-4f60-45a3-a906-98963f6e2d08 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Image pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 27 14:23:34.906467 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-76424d81-4f60-45a3-a906-98963f6e2d08 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 27 14:23:34.915420 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-76424d81-4f60-45a3-a906-98963f6e2d08 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:34.915880 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-76424d81-4f60-45a3-a906-98963f6e2d08 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:34.916686 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-76424d81-4f60-45a3-a906-98963f6e2d08 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:34.917112 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-76424d81-4f60-45a3-a906-98963f6e2d08 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:34.933582 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-76424d81-4f60-45a3-a906-98963f6e2d08 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Getting quotas for project 648321538a5a439baf7e39cee8742fc4. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:23:34.937601 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-76424d81-4f60-45a3-a906-98963f6e2d08 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Getting quotas for user 2e4c89b986aa4f2690ee1587172c17cb and project 648321538a5a439baf7e39cee8742fc4. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:23:34.948375 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-76424d81-4f60-45a3-a906-98963f6e2d08 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Going to run 1 instances... {{(pid=116105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 27 14:23:34.950754 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-76424d81-4f60-45a3-a906-98963f6e2d08 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c8bd383f-96c5-4e2b-aaa5-fabd68b307f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 27 14:23:34.997847 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-76424d81-4f60-45a3-a906-98963f6e2d08 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531319 Dec 27 14:23:34.998410 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 261/484] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Dec 27 14:23:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 27 14:23:35.008497 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-00af1324-b78d-4a3e-836d-3ea19fcb3e4d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:35.009338 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-00af1324-b78d-4a3e-836d-3ea19fcb3e4d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:35.067619 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-00af1324-b78d-4a3e-836d-3ea19fcb3e4d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:35.075982 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-00af1324-b78d-4a3e-836d-3ea19fcb3e4d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759" status: 200 len: 1217 microversion: 2.1 time: 0.071339 Dec 27 14:23:35.076534 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 224/485] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:35 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759 => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:35.350289 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d223ab04-47f9-494e-9656-1cd6d43f613a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:35.351247 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d223ab04-47f9-494e-9656-1cd6d43f613a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:35.357969 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d223ab04-47f9-494e-9656-1cd6d43f613a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:35.358408 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d223ab04-47f9-494e-9656-1cd6d43f613a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:35.359183 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d223ab04-47f9-494e-9656-1cd6d43f613a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:35.359612 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d223ab04-47f9-494e-9656-1cd6d43f613a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:35.444671 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d223ab04-47f9-494e-9656-1cd6d43f613a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.098288 Dec 27 14:23:35.446199 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 262/486] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:35 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:35.525677 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a193d019-48e4-4aeb-b2bf-afa15dfe47ab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:35.526778 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a193d019-48e4-4aeb-b2bf-afa15dfe47ab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:35.535390 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a193d019-48e4-4aeb-b2bf-afa15dfe47ab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:35.536379 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a193d019-48e4-4aeb-b2bf-afa15dfe47ab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:35.537322 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a193d019-48e4-4aeb-b2bf-afa15dfe47ab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:35.537928 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a193d019-48e4-4aeb-b2bf-afa15dfe47ab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:35.661793 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a193d019-48e4-4aeb-b2bf-afa15dfe47ab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 10009 microversion: 2.20 time: 0.140542 Dec 27 14:23:35.662485 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 225/487] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:35 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 10009 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:23:36.093281 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d6f79f96-db99-44c7-9906-7346ed327a65 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:36.093985 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d6f79f96-db99-44c7-9906-7346ed327a65 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:36.100842 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6f79f96-db99-44c7-9906-7346ed327a65 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:36.101303 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6f79f96-db99-44c7-9906-7346ed327a65 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:36.102091 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6f79f96-db99-44c7-9906-7346ed327a65 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:36.102531 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6f79f96-db99-44c7-9906-7346ed327a65 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:36.177303 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d6f79f96-db99-44c7-9906-7346ed327a65 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:36.187562 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d6f79f96-db99-44c7-9906-7346ed327a65 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759" status: 200 len: 1269 microversion: 2.1 time: 0.098256 Dec 27 14:23:36.188536 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 263/488] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:36 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759 => generated 1269 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:36.457107 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c89b484a-fcca-4004-873f-ea856218aae1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:36.458099 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c89b484a-fcca-4004-873f-ea856218aae1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:36.466311 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c89b484a-fcca-4004-873f-ea856218aae1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:36.466838 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c89b484a-fcca-4004-873f-ea856218aae1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:36.467695 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c89b484a-fcca-4004-873f-ea856218aae1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:36.468242 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c89b484a-fcca-4004-873f-ea856218aae1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:36.578255 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c89b484a-fcca-4004-873f-ea856218aae1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.124696 Dec 27 14:23:36.579114 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 226/489] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:36 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:36.673652 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-50fecba9-963a-41d6-aba2-e851c3812af8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:36.674808 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-50fecba9-963a-41d6-aba2-e851c3812af8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:36.682060 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-50fecba9-963a-41d6-aba2-e851c3812af8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:36.682563 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-50fecba9-963a-41d6-aba2-e851c3812af8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:36.683355 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-50fecba9-963a-41d6-aba2-e851c3812af8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:36.683792 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-50fecba9-963a-41d6-aba2-e851c3812af8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:36.795910 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-50fecba9-963a-41d6-aba2-e851c3812af8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 15025 microversion: 2.20 time: 0.125857 Dec 27 14:23:36.798144 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 264/490] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:36 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 15025 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:23:37.205452 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-caa78924-c83f-4487-9d54-9151e024be53 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:37.206150 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-caa78924-c83f-4487-9d54-9151e024be53 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:37.213682 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-caa78924-c83f-4487-9d54-9151e024be53 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:37.214130 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-caa78924-c83f-4487-9d54-9151e024be53 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:37.214921 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-caa78924-c83f-4487-9d54-9151e024be53 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:37.215357 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-caa78924-c83f-4487-9d54-9151e024be53 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:37.379867 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-caa78924-c83f-4487-9d54-9151e024be53 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:37.387972 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-caa78924-c83f-4487-9d54-9151e024be53 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759" status: 200 len: 1317 microversion: 2.1 time: 0.186570 Dec 27 14:23:37.388544 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 227/491] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:37 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:37.504614 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-28876acb-5b9a-4dcb-be63-be7c283625cc req-c9f90f62-924b-4e40-a681-72fdcc0b2d8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9463099-568c-4c60-a669-3cd59a85b759", "tag": "9011f65d-73a4-4471-925a-06f657690c61"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:37.506083 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:23:37.506083 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:23:37.514934 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-28876acb-5b9a-4dcb-be63-be7c283625cc req-c9f90f62-924b-4e40-a681-72fdcc0b2d8f service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:37.515377 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-28876acb-5b9a-4dcb-be63-be7c283625cc req-c9f90f62-924b-4e40-a681-72fdcc0b2d8f service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:37.526560 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-28876acb-5b9a-4dcb-be63-be7c283625cc req-c9f90f62-924b-4e40-a681-72fdcc0b2d8f service nova] Creating event network-changed:9011f65d-73a4-4471-925a-06f657690c61 for instance b9463099-568c-4c60-a669-3cd59a85b759 on hv-cinder-82301 Dec 27 14:23:37.531501 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-28876acb-5b9a-4dcb-be63-be7c283625cc req-c9f90f62-924b-4e40-a681-72fdcc0b2d8f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032406 Dec 27 14:23:37.532130 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 265/492] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:23:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:23:37.590002 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-33749d21-2c2e-4fd3-a73e-9e23299521a7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:37.591201 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-33749d21-2c2e-4fd3-a73e-9e23299521a7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:37.597531 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-33749d21-2c2e-4fd3-a73e-9e23299521a7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:37.598075 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-33749d21-2c2e-4fd3-a73e-9e23299521a7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:37.598936 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-33749d21-2c2e-4fd3-a73e-9e23299521a7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:37.599434 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-33749d21-2c2e-4fd3-a73e-9e23299521a7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:37.721211 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-33749d21-2c2e-4fd3-a73e-9e23299521a7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.135386 Dec 27 14:23:37.721895 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 228/493] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:37 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:37.811079 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2a979722-d2f7-427d-92fe-05069fdd86e4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:37.812198 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2a979722-d2f7-427d-92fe-05069fdd86e4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:37.818368 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2a979722-d2f7-427d-92fe-05069fdd86e4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:37.818821 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2a979722-d2f7-427d-92fe-05069fdd86e4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:37.819608 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2a979722-d2f7-427d-92fe-05069fdd86e4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:37.820067 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2a979722-d2f7-427d-92fe-05069fdd86e4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:37.925687 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2a979722-d2f7-427d-92fe-05069fdd86e4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 17526 microversion: 2.20 time: 0.120539 Dec 27 14:23:37.929932 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 266/494] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:37 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 17526 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:23:38.405374 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-391ae408-bff3-47a1-a73b-2f8b9b573d21 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:38.406334 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-391ae408-bff3-47a1-a73b-2f8b9b573d21 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:38.421575 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-391ae408-bff3-47a1-a73b-2f8b9b573d21 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:38.422047 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-391ae408-bff3-47a1-a73b-2f8b9b573d21 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:38.422864 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-391ae408-bff3-47a1-a73b-2f8b9b573d21 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:38.423309 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-391ae408-bff3-47a1-a73b-2f8b9b573d21 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:38.558672 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-391ae408-bff3-47a1-a73b-2f8b9b573d21 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:38.565862 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-391ae408-bff3-47a1-a73b-2f8b9b573d21 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759" status: 200 len: 1317 microversion: 2.1 time: 0.164487 Dec 27 14:23:38.566428 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 229/495] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:38 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:38.733130 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-abc0d4dd-3231-4991-96c5-db182dc63bda tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:38.734144 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-abc0d4dd-3231-4991-96c5-db182dc63bda tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:38.741078 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-abc0d4dd-3231-4991-96c5-db182dc63bda tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:38.741526 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-abc0d4dd-3231-4991-96c5-db182dc63bda tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:38.742303 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-abc0d4dd-3231-4991-96c5-db182dc63bda tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:38.742735 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-abc0d4dd-3231-4991-96c5-db182dc63bda tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:38.905300 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-abc0d4dd-3231-4991-96c5-db182dc63bda tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.176018 Dec 27 14:23:38.905955 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 267/496] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:38 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:38.937303 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dc8a94b3-6336-4d66-9ce0-273ce4cc47a3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:38.938163 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dc8a94b3-6336-4d66-9ce0-273ce4cc47a3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:38.944502 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc8a94b3-6336-4d66-9ce0-273ce4cc47a3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:38.944954 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc8a94b3-6336-4d66-9ce0-273ce4cc47a3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:38.946629 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc8a94b3-6336-4d66-9ce0-273ce4cc47a3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:38.947072 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc8a94b3-6336-4d66-9ce0-273ce4cc47a3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:39.055650 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dc8a94b3-6336-4d66-9ce0-273ce4cc47a3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 17781 microversion: 2.20 time: 0.121315 Dec 27 14:23:39.056342 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 230/497] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:38 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 17781 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:23:39.585196 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2d289898-c2ac-4f6a-bb0b-14efdb41be5e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:39.585929 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2d289898-c2ac-4f6a-bb0b-14efdb41be5e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:39.593659 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2d289898-c2ac-4f6a-bb0b-14efdb41be5e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:39.594113 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2d289898-c2ac-4f6a-bb0b-14efdb41be5e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:39.594890 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2d289898-c2ac-4f6a-bb0b-14efdb41be5e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:39.595349 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2d289898-c2ac-4f6a-bb0b-14efdb41be5e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:39.729755 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-2d289898-c2ac-4f6a-bb0b-14efdb41be5e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:39.737544 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2d289898-c2ac-4f6a-bb0b-14efdb41be5e tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759" status: 200 len: 1317 microversion: 2.1 time: 0.156266 Dec 27 14:23:39.738453 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 268/498] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:39 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:39.917515 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f6a30ad4-5834-41ba-b1d8-95680ebef72c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:39.918560 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f6a30ad4-5834-41ba-b1d8-95680ebef72c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:39.925517 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f6a30ad4-5834-41ba-b1d8-95680ebef72c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:39.925973 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f6a30ad4-5834-41ba-b1d8-95680ebef72c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:39.926761 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f6a30ad4-5834-41ba-b1d8-95680ebef72c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:39.927204 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f6a30ad4-5834-41ba-b1d8-95680ebef72c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:40.012796 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f6a30ad4-5834-41ba-b1d8-95680ebef72c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.099620 Dec 27 14:23:40.013468 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 231/499] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:39 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:40.066537 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8211502b-332d-454b-a12c-739e18c65b5d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:40.067461 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8211502b-332d-454b-a12c-739e18c65b5d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:40.074598 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8211502b-332d-454b-a12c-739e18c65b5d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:40.075050 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8211502b-332d-454b-a12c-739e18c65b5d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:40.075863 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8211502b-332d-454b-a12c-739e18c65b5d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:40.076340 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8211502b-332d-454b-a12c-739e18c65b5d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:40.258299 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8211502b-332d-454b-a12c-739e18c65b5d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 19342 microversion: 2.20 time: 0.195172 Dec 27 14:23:40.258963 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 269/500] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:40 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 19342 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:23:40.755309 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-01438095-ec99-46f9-913b-991e2e1c142d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:40.756029 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-01438095-ec99-46f9-913b-991e2e1c142d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:40.764879 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-01438095-ec99-46f9-913b-991e2e1c142d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:40.765324 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-01438095-ec99-46f9-913b-991e2e1c142d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:40.766117 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-01438095-ec99-46f9-913b-991e2e1c142d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:40.766567 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-01438095-ec99-46f9-913b-991e2e1c142d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:40.881589 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-10722803-3f2c-4641-ba2d-81ec86732957 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:40.882872 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-10722803-3f2c-4641-ba2d-81ec86732957 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:40.894406 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-10722803-3f2c-4641-ba2d-81ec86732957 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:40.894406 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-10722803-3f2c-4641-ba2d-81ec86732957 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:40.894755 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-10722803-3f2c-4641-ba2d-81ec86732957 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:40.895207 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-10722803-3f2c-4641-ba2d-81ec86732957 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:40.920523 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.objects.instance [None req-10722803-3f2c-4641-ba2d-81ec86732957 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lazy-loading 'flavor' on Instance uuid 8520422d-f3a9-443c-9e9a-12fb03ef1bcc {{(pid=116105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:23:40.923147 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-01438095-ec99-46f9-913b-991e2e1c142d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:40.930773 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-01438095-ec99-46f9-913b-991e2e1c142d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759" status: 200 len: 1317 microversion: 2.1 time: 0.179395 Dec 27 14:23:40.931396 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 232/501] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:40 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:41.025087 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6a846f9f-110e-48d1-a21b-7636db7fbfec tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:41.026869 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6a846f9f-110e-48d1-a21b-7636db7fbfec tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:41.033099 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6a846f9f-110e-48d1-a21b-7636db7fbfec tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:41.033603 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6a846f9f-110e-48d1-a21b-7636db7fbfec tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:41.034424 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6a846f9f-110e-48d1-a21b-7636db7fbfec tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:41.034871 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6a846f9f-110e-48d1-a21b-7636db7fbfec tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:41.042380 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-10722803-3f2c-4641-ba2d-81ec86732957 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "POST /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc/action" status: 200 len: 32 microversion: 2.1 time: 0.164860 Dec 27 14:23:41.047194 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 270/502] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:40 2021] POST /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 27 14:23:41.052888 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-42dc76f4-5356-4160-bdbe-62ee18dd003d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:41.053653 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-42dc76f4-5356-4160-bdbe-62ee18dd003d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:41.061431 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-42dc76f4-5356-4160-bdbe-62ee18dd003d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:41.061883 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-42dc76f4-5356-4160-bdbe-62ee18dd003d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:41.063128 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-42dc76f4-5356-4160-bdbe-62ee18dd003d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:41.063585 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-42dc76f4-5356-4160-bdbe-62ee18dd003d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:41.158309 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6a846f9f-110e-48d1-a21b-7636db7fbfec tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.137442 Dec 27 14:23:41.159491 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 233/503] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:41 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:41.270755 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-abec9734-2b32-4868-a192-789031ab07b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:41.271791 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-abec9734-2b32-4868-a192-789031ab07b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:41.279857 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abec9734-2b32-4868-a192-789031ab07b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:41.280526 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abec9734-2b32-4868-a192-789031ab07b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:41.281836 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abec9734-2b32-4868-a192-789031ab07b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:41.282337 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-abec9734-2b32-4868-a192-789031ab07b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:41.308060 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-42dc76f4-5356-4160-bdbe-62ee18dd003d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:41.317475 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-42dc76f4-5356-4160-bdbe-62ee18dd003d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.268234 Dec 27 14:23:41.318768 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 271/504] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:41 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:41.384785 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-abec9734-2b32-4868-a192-789031ab07b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 20991 microversion: 2.20 time: 0.118371 Dec 27 14:23:41.389098 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 234/505] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:41 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 20991 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:23:41.950115 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-59bef494-f700-475e-bcb7-e9ff7fb608dd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:41.950721 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-59bef494-f700-475e-bcb7-e9ff7fb608dd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:41.957312 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-59bef494-f700-475e-bcb7-e9ff7fb608dd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:41.957764 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-59bef494-f700-475e-bcb7-e9ff7fb608dd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:41.958542 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-59bef494-f700-475e-bcb7-e9ff7fb608dd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:41.958979 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-59bef494-f700-475e-bcb7-e9ff7fb608dd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:42.090803 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-59bef494-f700-475e-bcb7-e9ff7fb608dd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:42.098035 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-59bef494-f700-475e-bcb7-e9ff7fb608dd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759" status: 200 len: 1317 microversion: 2.1 time: 0.151684 Dec 27 14:23:42.098607 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 272/506] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:41 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:42.171257 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-68da9f24-f0df-462e-aa3d-e98bed078cb2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:42.172388 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-68da9f24-f0df-462e-aa3d-e98bed078cb2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:42.183886 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68da9f24-f0df-462e-aa3d-e98bed078cb2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:42.184344 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68da9f24-f0df-462e-aa3d-e98bed078cb2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:42.185342 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68da9f24-f0df-462e-aa3d-e98bed078cb2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:42.185778 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68da9f24-f0df-462e-aa3d-e98bed078cb2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:42.271076 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-68da9f24-f0df-462e-aa3d-e98bed078cb2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.103760 Dec 27 14:23:42.271644 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 235/507] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:42 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:42.334278 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b2a2dc72-aad1-4e03-aa80-19381c58ed82 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:42.334886 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b2a2dc72-aad1-4e03-aa80-19381c58ed82 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:42.341506 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b2a2dc72-aad1-4e03-aa80-19381c58ed82 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:42.341958 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b2a2dc72-aad1-4e03-aa80-19381c58ed82 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:42.342739 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b2a2dc72-aad1-4e03-aa80-19381c58ed82 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:42.343177 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b2a2dc72-aad1-4e03-aa80-19381c58ed82 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:42.397031 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-75bd5ced-a931-4ec7-8de8-4dd568db3c53 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:42.398150 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-75bd5ced-a931-4ec7-8de8-4dd568db3c53 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:42.406268 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75bd5ced-a931-4ec7-8de8-4dd568db3c53 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:42.406719 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75bd5ced-a931-4ec7-8de8-4dd568db3c53 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:42.407500 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75bd5ced-a931-4ec7-8de8-4dd568db3c53 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:42.407958 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-75bd5ced-a931-4ec7-8de8-4dd568db3c53 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:42.483674 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b2a2dc72-aad1-4e03-aa80-19381c58ed82 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:42.491297 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b2a2dc72-aad1-4e03-aa80-19381c58ed82 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.160744 Dec 27 14:23:42.491879 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 273/508] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:42 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:42.502612 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-75bd5ced-a931-4ec7-8de8-4dd568db3c53 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 22488 microversion: 2.20 time: 0.109414 Dec 27 14:23:42.503274 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 236/509] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:42 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 22488 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:23:43.114839 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d848d550-63fd-47ec-a7d4-a7b2112f1441 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:43.115448 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d848d550-63fd-47ec-a7d4-a7b2112f1441 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:43.122242 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d848d550-63fd-47ec-a7d4-a7b2112f1441 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:43.122720 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d848d550-63fd-47ec-a7d4-a7b2112f1441 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:43.128044 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d848d550-63fd-47ec-a7d4-a7b2112f1441 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:43.128044 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d848d550-63fd-47ec-a7d4-a7b2112f1441 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:43.257297 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d848d550-63fd-47ec-a7d4-a7b2112f1441 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:43.264466 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d848d550-63fd-47ec-a7d4-a7b2112f1441 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759" status: 200 len: 1317 microversion: 2.1 time: 0.153258 Dec 27 14:23:43.265034 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 274/510] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:43 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:43.283216 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0b2f1b30-e92d-4090-9421-b8f6c2cc803e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:43.284251 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0b2f1b30-e92d-4090-9421-b8f6c2cc803e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:43.291749 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0b2f1b30-e92d-4090-9421-b8f6c2cc803e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:43.292277 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0b2f1b30-e92d-4090-9421-b8f6c2cc803e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:43.293064 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0b2f1b30-e92d-4090-9421-b8f6c2cc803e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:43.293500 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0b2f1b30-e92d-4090-9421-b8f6c2cc803e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:43.384631 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0b2f1b30-e92d-4090-9421-b8f6c2cc803e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.105356 Dec 27 14:23:43.385439 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 237/511] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:43 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:43.508271 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8f0059ce-021f-4238-935d-9f56b3d3842a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:43.509124 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8f0059ce-021f-4238-935d-9f56b3d3842a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:43.514346 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d1fabfcf-b3a1-4d7e-909e-77166da51acc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:43.515351 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d1fabfcf-b3a1-4d7e-909e-77166da51acc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:43.515479 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f0059ce-021f-4238-935d-9f56b3d3842a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:43.515966 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f0059ce-021f-4238-935d-9f56b3d3842a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:43.516745 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f0059ce-021f-4238-935d-9f56b3d3842a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:43.517178 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f0059ce-021f-4238-935d-9f56b3d3842a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:43.522200 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1fabfcf-b3a1-4d7e-909e-77166da51acc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:43.522651 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1fabfcf-b3a1-4d7e-909e-77166da51acc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:43.526773 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1fabfcf-b3a1-4d7e-909e-77166da51acc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:43.526773 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1fabfcf-b3a1-4d7e-909e-77166da51acc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:43.621121 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d1fabfcf-b3a1-4d7e-909e-77166da51acc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 23218 microversion: 2.20 time: 0.110795 Dec 27 14:23:43.624957 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 238/512] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:43 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 23218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:23:43.647802 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8f0059ce-021f-4238-935d-9f56b3d3842a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:43.655968 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8f0059ce-021f-4238-935d-9f56b3d3842a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.151260 Dec 27 14:23:43.656798 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 275/513] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:43 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:44.282378 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0011abc8-2f91-4a0e-b784-8ce017d439cd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:44.283105 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0011abc8-2f91-4a0e-b784-8ce017d439cd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:44.291139 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0011abc8-2f91-4a0e-b784-8ce017d439cd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:44.291724 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0011abc8-2f91-4a0e-b784-8ce017d439cd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:44.292418 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0011abc8-2f91-4a0e-b784-8ce017d439cd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:44.292854 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0011abc8-2f91-4a0e-b784-8ce017d439cd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:44.396313 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d6e1221f-3dff-4351-81d8-a47bb7c8f64d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:44.397217 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d6e1221f-3dff-4351-81d8-a47bb7c8f64d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:44.404149 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6e1221f-3dff-4351-81d8-a47bb7c8f64d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:44.404605 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6e1221f-3dff-4351-81d8-a47bb7c8f64d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:44.405407 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6e1221f-3dff-4351-81d8-a47bb7c8f64d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:44.405842 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d6e1221f-3dff-4351-81d8-a47bb7c8f64d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:44.427262 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0011abc8-2f91-4a0e-b784-8ce017d439cd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:44.434531 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0011abc8-2f91-4a0e-b784-8ce017d439cd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759" status: 200 len: 1317 microversion: 2.1 time: 0.156400 Dec 27 14:23:44.435096 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 239/514] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:44 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:44.503730 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d6e1221f-3dff-4351-81d8-a47bb7c8f64d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.111195 Dec 27 14:23:44.504419 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 276/515] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:44 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:23:44.632459 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ee99f820-5400-4dda-b38b-883a08fef95f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:44.634134 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ee99f820-5400-4dda-b38b-883a08fef95f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:44.640479 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ee99f820-5400-4dda-b38b-883a08fef95f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:44.640927 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ee99f820-5400-4dda-b38b-883a08fef95f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:44.641704 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ee99f820-5400-4dda-b38b-883a08fef95f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:44.642140 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ee99f820-5400-4dda-b38b-883a08fef95f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:44.674239 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b01b9e5a-16c7-4e7a-8ded-9777137ea383 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:44.675021 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b01b9e5a-16c7-4e7a-8ded-9777137ea383 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:44.682180 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b01b9e5a-16c7-4e7a-8ded-9777137ea383 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:44.682635 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b01b9e5a-16c7-4e7a-8ded-9777137ea383 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:44.683419 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b01b9e5a-16c7-4e7a-8ded-9777137ea383 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:44.683895 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b01b9e5a-16c7-4e7a-8ded-9777137ea383 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:44.740478 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ee99f820-5400-4dda-b38b-883a08fef95f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 23880 microversion: 2.20 time: 0.111525 Dec 27 14:23:44.744321 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 240/516] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:44 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 23880 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:23:44.819026 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b01b9e5a-16c7-4e7a-8ded-9777137ea383 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:44.827605 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b01b9e5a-16c7-4e7a-8ded-9777137ea383 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.157409 Dec 27 14:23:44.828235 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 277/517] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:44 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:45.304497 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-802941d5-1115-47ef-ac49-69d019e3ac20 req-9e0017a5-6039-4646-8825-cf6dae4ef102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9463099-568c-4c60-a669-3cd59a85b759", "name": "network-vif-plugged", "status": "completed", "tag": "9011f65d-73a4-4471-925a-06f657690c61"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:45.306764 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:23:45.306764 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:23:45.315209 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-802941d5-1115-47ef-ac49-69d019e3ac20 req-9e0017a5-6039-4646-8825-cf6dae4ef102 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:45.315812 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-802941d5-1115-47ef-ac49-69d019e3ac20 req-9e0017a5-6039-4646-8825-cf6dae4ef102 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:45.327347 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-802941d5-1115-47ef-ac49-69d019e3ac20 req-9e0017a5-6039-4646-8825-cf6dae4ef102 service nova] Creating event network-vif-plugged:9011f65d-73a4-4471-925a-06f657690c61 for instance b9463099-568c-4c60-a669-3cd59a85b759 on hv-cinder-82301 Dec 27 14:23:45.332119 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-802941d5-1115-47ef-ac49-69d019e3ac20 req-9e0017a5-6039-4646-8825-cf6dae4ef102 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031671 Dec 27 14:23:45.333034 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 241/518] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:23:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:23:45.453589 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-172a471d-d586-46c9-811f-816e3d739c70 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:45.454322 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-172a471d-d586-46c9-811f-816e3d739c70 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:45.460721 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-172a471d-d586-46c9-811f-816e3d739c70 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:45.461275 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-172a471d-d586-46c9-811f-816e3d739c70 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:45.462031 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-172a471d-d586-46c9-811f-816e3d739c70 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:45.462448 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-172a471d-d586-46c9-811f-816e3d739c70 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:45.516200 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-936d2d56-9cd2-4349-b80e-349f7f18d927 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:45.517208 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-936d2d56-9cd2-4349-b80e-349f7f18d927 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:45.523239 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-936d2d56-9cd2-4349-b80e-349f7f18d927 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:45.524457 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-936d2d56-9cd2-4349-b80e-349f7f18d927 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:45.525315 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-936d2d56-9cd2-4349-b80e-349f7f18d927 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:45.525763 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-936d2d56-9cd2-4349-b80e-349f7f18d927 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:45.606839 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-936d2d56-9cd2-4349-b80e-349f7f18d927 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.095000 Dec 27 14:23:45.610839 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 242/519] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:45 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:23:45.644220 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-172a471d-d586-46c9-811f-816e3d739c70 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:45.652785 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-172a471d-d586-46c9-811f-816e3d739c70 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759" status: 200 len: 1317 microversion: 2.1 time: 0.202947 Dec 27 14:23:45.653358 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 278/520] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:45 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759 => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:45.752386 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-05fea866-c87b-47a5-9500-de624c7d6e15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:45.753413 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-05fea866-c87b-47a5-9500-de624c7d6e15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:45.761298 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05fea866-c87b-47a5-9500-de624c7d6e15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:45.761743 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05fea866-c87b-47a5-9500-de624c7d6e15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:45.762512 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05fea866-c87b-47a5-9500-de624c7d6e15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:45.762992 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05fea866-c87b-47a5-9500-de624c7d6e15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:45.844491 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8d136140-e60a-4bca-8f89-001e07e386d5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:45.845014 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8d136140-e60a-4bca-8f89-001e07e386d5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:45.851326 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8d136140-e60a-4bca-8f89-001e07e386d5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:45.851934 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8d136140-e60a-4bca-8f89-001e07e386d5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:45.852718 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8d136140-e60a-4bca-8f89-001e07e386d5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:45.853143 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8d136140-e60a-4bca-8f89-001e07e386d5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:45.984245 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8d136140-e60a-4bca-8f89-001e07e386d5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:45.991974 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8d136140-e60a-4bca-8f89-001e07e386d5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.151171 Dec 27 14:23:45.993366 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 279/521] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:45 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:46.043531 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-05fea866-c87b-47a5-9500-de624c7d6e15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 25004 microversion: 2.20 time: 0.295062 Dec 27 14:23:46.044205 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 243/522] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:45 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 25004 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:23:46.618775 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d448c8bb-9e4d-4ac8-b0e0-a018cc0f79ee tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:46.619690 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d448c8bb-9e4d-4ac8-b0e0-a018cc0f79ee tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:46.625995 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d448c8bb-9e4d-4ac8-b0e0-a018cc0f79ee tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:46.626445 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d448c8bb-9e4d-4ac8-b0e0-a018cc0f79ee tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:46.627215 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d448c8bb-9e4d-4ac8-b0e0-a018cc0f79ee tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:46.627648 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d448c8bb-9e4d-4ac8-b0e0-a018cc0f79ee tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:46.670163 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cf3e96a1-3510-4698-bb35-d19fceb2874c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:46.670870 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cf3e96a1-3510-4698-bb35-d19fceb2874c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:46.677788 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf3e96a1-3510-4698-bb35-d19fceb2874c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:46.678242 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf3e96a1-3510-4698-bb35-d19fceb2874c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:46.679029 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf3e96a1-3510-4698-bb35-d19fceb2874c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:46.679469 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf3e96a1-3510-4698-bb35-d19fceb2874c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:46.811543 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d448c8bb-9e4d-4ac8-b0e0-a018cc0f79ee tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.196738 Dec 27 14:23:46.811699 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cf3e96a1-3510-4698-bb35-d19fceb2874c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:46.815400 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 280/523] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:46 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:46.819358 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cf3e96a1-3510-4698-bb35-d19fceb2874c tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759" status: 200 len: 1317 microversion: 2.1 time: 0.153230 Dec 27 14:23:46.819938 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 244/524] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:46 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:47.010102 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-049efe27-2898-47ba-8864-daec25d0edb0 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:47.010832 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-049efe27-2898-47ba-8864-daec25d0edb0 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:47.017699 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-049efe27-2898-47ba-8864-daec25d0edb0 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:47.018154 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-049efe27-2898-47ba-8864-daec25d0edb0 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:47.018932 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-049efe27-2898-47ba-8864-daec25d0edb0 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:47.019367 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-049efe27-2898-47ba-8864-daec25d0edb0 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:47.054840 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2202c146-0f03-4ee1-afe5-966f96c27776 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:47.055860 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2202c146-0f03-4ee1-afe5-966f96c27776 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:47.062263 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2202c146-0f03-4ee1-afe5-966f96c27776 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:47.062710 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2202c146-0f03-4ee1-afe5-966f96c27776 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:47.063497 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2202c146-0f03-4ee1-afe5-966f96c27776 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:47.064035 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2202c146-0f03-4ee1-afe5-966f96c27776 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:47.151034 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-049efe27-2898-47ba-8864-daec25d0edb0 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:47.151452 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2202c146-0f03-4ee1-afe5-966f96c27776 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 25818 microversion: 2.20 time: 0.100130 Dec 27 14:23:47.152170 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 245/525] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:47 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 25818 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:23:47.159634 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-049efe27-2898-47ba-8864-daec25d0edb0 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.153712 Dec 27 14:23:47.160245 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 281/526] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:47 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:47.826211 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b28901c4-09a7-4e8d-8204-af90fde6bc04 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:47.827213 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b28901c4-09a7-4e8d-8204-af90fde6bc04 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:47.834264 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b28901c4-09a7-4e8d-8204-af90fde6bc04 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:47.834712 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b28901c4-09a7-4e8d-8204-af90fde6bc04 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:47.835494 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b28901c4-09a7-4e8d-8204-af90fde6bc04 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:47.836032 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b28901c4-09a7-4e8d-8204-af90fde6bc04 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:47.836406 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-911ba7ad-010e-4393-ba55-6d1fe21d5ce3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:47.837193 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-911ba7ad-010e-4393-ba55-6d1fe21d5ce3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:47.846783 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-911ba7ad-010e-4393-ba55-6d1fe21d5ce3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:47.846783 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-911ba7ad-010e-4393-ba55-6d1fe21d5ce3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:47.846783 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-911ba7ad-010e-4393-ba55-6d1fe21d5ce3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:47.846783 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-911ba7ad-010e-4393-ba55-6d1fe21d5ce3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:47.940568 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b28901c4-09a7-4e8d-8204-af90fde6bc04 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.119691 Dec 27 14:23:47.944630 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 246/527] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:47 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:47.995000 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-911ba7ad-010e-4393-ba55-6d1fe21d5ce3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:48.002337 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-911ba7ad-010e-4393-ba55-6d1fe21d5ce3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759" status: 200 len: 1317 microversion: 2.1 time: 0.170100 Dec 27 14:23:48.002954 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 282/528] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:47 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:48.167153 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2f7b6f66-bf46-4abd-bf9b-d28eb03483aa tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:48.168820 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2f7b6f66-bf46-4abd-bf9b-d28eb03483aa tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:48.176176 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-75295e56-7eb1-4b68-b2b8-517b25577e26 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:48.176688 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f7b6f66-bf46-4abd-bf9b-d28eb03483aa tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:48.177056 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f7b6f66-bf46-4abd-bf9b-d28eb03483aa tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:48.177189 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-75295e56-7eb1-4b68-b2b8-517b25577e26 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:48.177885 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f7b6f66-bf46-4abd-bf9b-d28eb03483aa tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:48.178406 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f7b6f66-bf46-4abd-bf9b-d28eb03483aa tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:48.184987 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-75295e56-7eb1-4b68-b2b8-517b25577e26 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:48.185439 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-75295e56-7eb1-4b68-b2b8-517b25577e26 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:48.186226 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-75295e56-7eb1-4b68-b2b8-517b25577e26 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:48.186664 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-75295e56-7eb1-4b68-b2b8-517b25577e26 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:48.298810 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2f7b6f66-bf46-4abd-bf9b-d28eb03483aa tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 26209 microversion: 2.20 time: 0.138470 Dec 27 14:23:48.300111 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 247/529] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:48 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 26209 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:23:48.344206 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-75295e56-7eb1-4b68-b2b8-517b25577e26 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:48.352762 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-75295e56-7eb1-4b68-b2b8-517b25577e26 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.180089 Dec 27 14:23:48.353346 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 283/530] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:48 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:48.952813 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-52381f70-bf56-412c-a226-7017534fc807 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:48.953830 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-52381f70-bf56-412c-a226-7017534fc807 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:48.960726 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-52381f70-bf56-412c-a226-7017534fc807 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:48.961792 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-52381f70-bf56-412c-a226-7017534fc807 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:48.962748 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-52381f70-bf56-412c-a226-7017534fc807 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:48.963192 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-52381f70-bf56-412c-a226-7017534fc807 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:49.020274 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b8648cde-86db-445c-94b3-d5d6fe5bb33d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:49.020902 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b8648cde-86db-445c-94b3-d5d6fe5bb33d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:49.027941 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b8648cde-86db-445c-94b3-d5d6fe5bb33d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:49.028392 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b8648cde-86db-445c-94b3-d5d6fe5bb33d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:49.029171 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b8648cde-86db-445c-94b3-d5d6fe5bb33d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:49.029605 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b8648cde-86db-445c-94b3-d5d6fe5bb33d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:49.052607 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-52381f70-bf56-412c-a226-7017534fc807 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.103674 Dec 27 14:23:49.053260 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 248/531] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:48 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:49.162019 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b8648cde-86db-445c-94b3-d5d6fe5bb33d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:49.169571 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b8648cde-86db-445c-94b3-d5d6fe5bb33d tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759" status: 200 len: 1317 microversion: 2.1 time: 0.152872 Dec 27 14:23:49.170142 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 284/532] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:49 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:49.311538 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c1f84942-3664-4ad5-9a5e-f87b150605b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:49.312611 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c1f84942-3664-4ad5-9a5e-f87b150605b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:49.319464 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1f84942-3664-4ad5-9a5e-f87b150605b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:49.319947 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1f84942-3664-4ad5-9a5e-f87b150605b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:49.321334 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1f84942-3664-4ad5-9a5e-f87b150605b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:49.321765 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1f84942-3664-4ad5-9a5e-f87b150605b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:49.369308 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fe41f332-7b33-46b3-b3c0-b0b6c6595a3a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:49.369838 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fe41f332-7b33-46b3-b3c0-b0b6c6595a3a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:49.376018 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe41f332-7b33-46b3-b3c0-b0b6c6595a3a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:49.376469 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe41f332-7b33-46b3-b3c0-b0b6c6595a3a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:49.377241 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe41f332-7b33-46b3-b3c0-b0b6c6595a3a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:49.377680 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fe41f332-7b33-46b3-b3c0-b0b6c6595a3a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:49.466243 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c1f84942-3664-4ad5-9a5e-f87b150605b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 26506 microversion: 2.20 time: 0.158521 Dec 27 14:23:49.470005 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 249/533] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:49 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 26506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:23:49.509075 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-fe41f332-7b33-46b3-b3c0-b0b6c6595a3a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:49.516802 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fe41f332-7b33-46b3-b3c0-b0b6c6595a3a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.151686 Dec 27 14:23:49.517369 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 285/534] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:49 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:50.064809 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6ccdaefe-6953-4889-906f-595146db7008 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:50.065817 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6ccdaefe-6953-4889-906f-595146db7008 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:50.072843 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6ccdaefe-6953-4889-906f-595146db7008 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:50.073295 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6ccdaefe-6953-4889-906f-595146db7008 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:50.074081 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6ccdaefe-6953-4889-906f-595146db7008 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:50.074523 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6ccdaefe-6953-4889-906f-595146db7008 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:50.186972 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-69f31b9e-c263-40a8-863f-d60d08473798 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:50.187576 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-69f31b9e-c263-40a8-863f-d60d08473798 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:50.193825 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-69f31b9e-c263-40a8-863f-d60d08473798 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:50.194270 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-69f31b9e-c263-40a8-863f-d60d08473798 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:50.195039 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-69f31b9e-c263-40a8-863f-d60d08473798 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:50.195475 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-69f31b9e-c263-40a8-863f-d60d08473798 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:50.215359 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6ccdaefe-6953-4889-906f-595146db7008 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.154422 Dec 27 14:23:50.219300 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 250/535] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:50 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:50.323822 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-69f31b9e-c263-40a8-863f-d60d08473798 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:50.330951 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-69f31b9e-c263-40a8-863f-d60d08473798 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759" status: 200 len: 1317 microversion: 2.1 time: 0.147717 Dec 27 14:23:50.331504 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 286/536] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:50 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:50.478942 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a62ef29d-4e0c-47d5-95da-70a96f755a49 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:50.479988 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a62ef29d-4e0c-47d5-95da-70a96f755a49 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:50.486840 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a62ef29d-4e0c-47d5-95da-70a96f755a49 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:50.487326 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a62ef29d-4e0c-47d5-95da-70a96f755a49 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:50.488148 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a62ef29d-4e0c-47d5-95da-70a96f755a49 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:50.488584 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a62ef29d-4e0c-47d5-95da-70a96f755a49 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:50.533275 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-787d616c-2f4f-45b6-a6e2-c937779eb527 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:50.533949 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-787d616c-2f4f-45b6-a6e2-c937779eb527 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:50.540528 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-787d616c-2f4f-45b6-a6e2-c937779eb527 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:50.540982 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-787d616c-2f4f-45b6-a6e2-c937779eb527 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:50.541760 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-787d616c-2f4f-45b6-a6e2-c937779eb527 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:50.542194 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-787d616c-2f4f-45b6-a6e2-c937779eb527 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:50.626950 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a62ef29d-4e0c-47d5-95da-70a96f755a49 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 26879 microversion: 2.20 time: 0.152566 Dec 27 14:23:50.631083 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 251/537] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:50 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 26879 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:23:50.922678 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-787d616c-2f4f-45b6-a6e2-c937779eb527 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:50.931623 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-787d616c-2f4f-45b6-a6e2-c937779eb527 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.402259 Dec 27 14:23:50.932234 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 287/538] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:50 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:51.227677 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cecf1bd2-b68d-4bdb-bc71-1b26f33dd2d9 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:51.228761 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cecf1bd2-b68d-4bdb-bc71-1b26f33dd2d9 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:51.235567 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cecf1bd2-b68d-4bdb-bc71-1b26f33dd2d9 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:51.236044 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cecf1bd2-b68d-4bdb-bc71-1b26f33dd2d9 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:51.236816 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cecf1bd2-b68d-4bdb-bc71-1b26f33dd2d9 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:51.237248 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cecf1bd2-b68d-4bdb-bc71-1b26f33dd2d9 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:51.340387 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cecf1bd2-b68d-4bdb-bc71-1b26f33dd2d9 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.117047 Dec 27 14:23:51.341093 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 252/539] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:51 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:51.348718 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c55869f3-80dc-448e-9db6-5cee718beca2 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:51.349376 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c55869f3-80dc-448e-9db6-5cee718beca2 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:51.357260 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c55869f3-80dc-448e-9db6-5cee718beca2 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:51.357807 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c55869f3-80dc-448e-9db6-5cee718beca2 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:51.358738 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c55869f3-80dc-448e-9db6-5cee718beca2 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:51.359226 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c55869f3-80dc-448e-9db6-5cee718beca2 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:51.498238 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c55869f3-80dc-448e-9db6-5cee718beca2 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:51.505821 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c55869f3-80dc-448e-9db6-5cee718beca2 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759" status: 200 len: 1507 microversion: 2.1 time: 0.161325 Dec 27 14:23:51.506395 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 288/540] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:51 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:51.639292 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-79343dde-4c94-446a-8d7f-bc214a555c29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:51.640337 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-79343dde-4c94-446a-8d7f-bc214a555c29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:51.647418 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-79343dde-4c94-446a-8d7f-bc214a555c29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:51.647921 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-79343dde-4c94-446a-8d7f-bc214a555c29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:51.649366 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-79343dde-4c94-446a-8d7f-bc214a555c29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:51.649800 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-79343dde-4c94-446a-8d7f-bc214a555c29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:51.783489 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-79343dde-4c94-446a-8d7f-bc214a555c29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 27439 microversion: 2.20 time: 0.148087 Dec 27 14:23:51.786766 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 253/541] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:51 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 27439 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:23:51.949420 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3cecd9f8-d663-4c93-9b5d-7072189a687e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:51.950056 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3cecd9f8-d663-4c93-9b5d-7072189a687e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:51.956060 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3cecd9f8-d663-4c93-9b5d-7072189a687e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:51.956512 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3cecd9f8-d663-4c93-9b5d-7072189a687e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:51.957375 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3cecd9f8-d663-4c93-9b5d-7072189a687e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:51.957723 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3cecd9f8-d663-4c93-9b5d-7072189a687e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:52.105676 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3cecd9f8-d663-4c93-9b5d-7072189a687e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:52.114052 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3cecd9f8-d663-4c93-9b5d-7072189a687e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.168847 Dec 27 14:23:52.114644 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 289/542] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:51 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:52.352803 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-db56fca7-9fcc-4a0c-a4a8-733f0dda6462 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:52.353758 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-db56fca7-9fcc-4a0c-a4a8-733f0dda6462 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:52.360708 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db56fca7-9fcc-4a0c-a4a8-733f0dda6462 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:52.361166 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db56fca7-9fcc-4a0c-a4a8-733f0dda6462 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:52.361958 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db56fca7-9fcc-4a0c-a4a8-733f0dda6462 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:52.362408 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db56fca7-9fcc-4a0c-a4a8-733f0dda6462 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:52.448779 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-db56fca7-9fcc-4a0c-a4a8-733f0dda6462 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.100273 Dec 27 14:23:52.449458 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 254/543] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:52 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:52.794905 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d1daa762-0ce1-41df-a3a5-c60452bdd4b4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:52.795863 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d1daa762-0ce1-41df-a3a5-c60452bdd4b4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:52.802193 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d1daa762-0ce1-41df-a3a5-c60452bdd4b4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:52.802650 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d1daa762-0ce1-41df-a3a5-c60452bdd4b4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:52.803440 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d1daa762-0ce1-41df-a3a5-c60452bdd4b4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:52.803898 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d1daa762-0ce1-41df-a3a5-c60452bdd4b4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:52.893189 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d1daa762-0ce1-41df-a3a5-c60452bdd4b4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 27684 microversion: 2.20 time: 0.101732 Dec 27 14:23:52.894059 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 290/544] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:52 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 27684 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:23:53.132673 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b84f5e10-00b1-487b-8413-82afec00934e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:53.133224 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b84f5e10-00b1-487b-8413-82afec00934e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:53.140181 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b84f5e10-00b1-487b-8413-82afec00934e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:53.140762 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b84f5e10-00b1-487b-8413-82afec00934e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:53.141527 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b84f5e10-00b1-487b-8413-82afec00934e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:53.141965 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b84f5e10-00b1-487b-8413-82afec00934e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:53.272369 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b84f5e10-00b1-487b-8413-82afec00934e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:53.281584 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b84f5e10-00b1-487b-8413-82afec00934e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.152817 Dec 27 14:23:53.282172 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 255/545] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:53 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:53.461373 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c8b702aa-bd1d-47f6-9ea9-122efc5f3f2b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:53.462386 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c8b702aa-bd1d-47f6-9ea9-122efc5f3f2b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:53.469050 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c8b702aa-bd1d-47f6-9ea9-122efc5f3f2b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:53.469497 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c8b702aa-bd1d-47f6-9ea9-122efc5f3f2b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:53.470279 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c8b702aa-bd1d-47f6-9ea9-122efc5f3f2b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:53.470707 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c8b702aa-bd1d-47f6-9ea9-122efc5f3f2b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:53.575127 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c8b702aa-bd1d-47f6-9ea9-122efc5f3f2b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28602 microversion: 2.1 time: 0.118021 Dec 27 14:23:53.575731 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 291/546] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:53 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28602 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:53.864264 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d73fc236-6be4-4f35-bd61-4ffe97a76a28 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b135bcb-7450-4ade-a7ef-9148ea426d58"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:53.865385 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d73fc236-6be4-4f35-bd61-4ffe97a76a28 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:53.872449 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d73fc236-6be4-4f35-bd61-4ffe97a76a28 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:53.872931 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d73fc236-6be4-4f35-bd61-4ffe97a76a28 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:53.873722 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d73fc236-6be4-4f35-bd61-4ffe97a76a28 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:53.874159 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d73fc236-6be4-4f35-bd61-4ffe97a76a28 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:53.905394 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-99ce9d32-d500-4805-818b-ea9991c0f844 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:53.906665 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-99ce9d32-d500-4805-818b-ea9991c0f844 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:53.914311 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99ce9d32-d500-4805-818b-ea9991c0f844 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:53.914773 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99ce9d32-d500-4805-818b-ea9991c0f844 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:53.915561 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99ce9d32-d500-4805-818b-ea9991c0f844 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:53.916029 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99ce9d32-d500-4805-818b-ea9991c0f844 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:54.057305 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-99ce9d32-d500-4805-818b-ea9991c0f844 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 27850 microversion: 2.20 time: 0.155718 Dec 27 14:23:54.058010 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 292/547] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:53 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 27850 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:23:54.191708 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d73fc236-6be4-4f35-bd61-4ffe97a76a28 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "POST /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331009 Dec 27 14:23:54.192386 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 256/548] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Dec 27 14:23:53 2021] POST /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:23:54.298703 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-49808474-fbd4-4ed4-b5cf-a09cd26a60dd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:54.299412 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-49808474-fbd4-4ed4-b5cf-a09cd26a60dd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:54.307305 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-49808474-fbd4-4ed4-b5cf-a09cd26a60dd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:54.307761 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-49808474-fbd4-4ed4-b5cf-a09cd26a60dd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:54.308581 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-49808474-fbd4-4ed4-b5cf-a09cd26a60dd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:54.309022 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-49808474-fbd4-4ed4-b5cf-a09cd26a60dd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:54.444282 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-49808474-fbd4-4ed4-b5cf-a09cd26a60dd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:54.452458 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-49808474-fbd4-4ed4-b5cf-a09cd26a60dd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.157743 Dec 27 14:23:54.453031 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 293/549] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:54 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:54.587370 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5060153c-d28a-4aef-a29f-0434b0dd2a5c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:54.588491 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5060153c-d28a-4aef-a29f-0434b0dd2a5c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:54.594997 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5060153c-d28a-4aef-a29f-0434b0dd2a5c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:54.595453 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5060153c-d28a-4aef-a29f-0434b0dd2a5c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:54.596283 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5060153c-d28a-4aef-a29f-0434b0dd2a5c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:54.596725 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5060153c-d28a-4aef-a29f-0434b0dd2a5c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:54.698881 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5060153c-d28a-4aef-a29f-0434b0dd2a5c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 28824 microversion: 2.1 time: 0.116160 Dec 27 14:23:54.699560 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 257/550] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:54 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 28824 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:55.069107 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-476bac47-2ae4-4d85-a76b-094286eb2bee tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:55.070431 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-476bac47-2ae4-4d85-a76b-094286eb2bee tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:55.077158 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-476bac47-2ae4-4d85-a76b-094286eb2bee tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:55.077617 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-476bac47-2ae4-4d85-a76b-094286eb2bee tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:55.078401 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-476bac47-2ae4-4d85-a76b-094286eb2bee tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:55.078841 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-476bac47-2ae4-4d85-a76b-094286eb2bee tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:55.186888 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-476bac47-2ae4-4d85-a76b-094286eb2bee tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28045 microversion: 2.20 time: 0.121376 Dec 27 14:23:55.187566 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 294/551] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:55 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28045 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:23:55.470099 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fb71f744-e024-4aa7-a142-233e4cf76b27 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:55.470828 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fb71f744-e024-4aa7-a142-233e4cf76b27 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:55.477845 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb71f744-e024-4aa7-a142-233e4cf76b27 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:55.478294 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb71f744-e024-4aa7-a142-233e4cf76b27 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:55.479071 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb71f744-e024-4aa7-a142-233e4cf76b27 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:55.479507 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb71f744-e024-4aa7-a142-233e4cf76b27 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:55.609652 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fb71f744-e024-4aa7-a142-233e4cf76b27 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:55.618297 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fb71f744-e024-4aa7-a142-233e4cf76b27 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.152218 Dec 27 14:23:55.618863 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 258/552] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:55 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:55.711564 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-dc859e9a-2ec0-491b-a8ec-b5dca1601845 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:55.712607 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-dc859e9a-2ec0-491b-a8ec-b5dca1601845 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:55.719421 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dc859e9a-2ec0-491b-a8ec-b5dca1601845 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:55.719907 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dc859e9a-2ec0-491b-a8ec-b5dca1601845 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:55.720753 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dc859e9a-2ec0-491b-a8ec-b5dca1601845 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:55.721144 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dc859e9a-2ec0-491b-a8ec-b5dca1601845 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:55.833834 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-dc859e9a-2ec0-491b-a8ec-b5dca1601845 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 29742 microversion: 2.1 time: 0.126880 Dec 27 14:23:55.834599 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 295/553] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:55 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 29742 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:56.198356 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c1686a2e-ef1f-42f3-8ed8-cb63c433bb25 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:56.199350 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c1686a2e-ef1f-42f3-8ed8-cb63c433bb25 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:56.206128 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1686a2e-ef1f-42f3-8ed8-cb63c433bb25 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:56.206581 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1686a2e-ef1f-42f3-8ed8-cb63c433bb25 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:56.207425 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1686a2e-ef1f-42f3-8ed8-cb63c433bb25 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:56.207884 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c1686a2e-ef1f-42f3-8ed8-cb63c433bb25 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:56.311173 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c1686a2e-ef1f-42f3-8ed8-cb63c433bb25 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28112 microversion: 2.20 time: 0.116303 Dec 27 14:23:56.311883 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 259/554] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:56 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28112 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:23:56.635024 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fc404f39-a62a-4f27-95cc-1d4fc8d28548 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:56.635712 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fc404f39-a62a-4f27-95cc-1d4fc8d28548 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:56.642595 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fc404f39-a62a-4f27-95cc-1d4fc8d28548 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:56.643084 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fc404f39-a62a-4f27-95cc-1d4fc8d28548 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:56.643865 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fc404f39-a62a-4f27-95cc-1d4fc8d28548 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:56.644286 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fc404f39-a62a-4f27-95cc-1d4fc8d28548 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:56.774266 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-fc404f39-a62a-4f27-95cc-1d4fc8d28548 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:56.782675 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fc404f39-a62a-4f27-95cc-1d4fc8d28548 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.151645 Dec 27 14:23:56.783234 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 296/555] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:56 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:56.845623 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9aacdebb-0ac2-4ce4-87d8-07bce2e64f46 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:56.846627 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9aacdebb-0ac2-4ce4-87d8-07bce2e64f46 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:56.853633 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9aacdebb-0ac2-4ce4-87d8-07bce2e64f46 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:56.854083 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9aacdebb-0ac2-4ce4-87d8-07bce2e64f46 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:56.854884 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9aacdebb-0ac2-4ce4-87d8-07bce2e64f46 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:56.855304 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9aacdebb-0ac2-4ce4-87d8-07bce2e64f46 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:56.966977 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9aacdebb-0ac2-4ce4-87d8-07bce2e64f46 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 30814 microversion: 2.1 time: 0.125114 Dec 27 14:23:56.967641 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 260/556] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:56 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 30814 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:57.322486 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-27890154-5d69-4613-b7a3-d26f2dedc98e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:57.323402 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-27890154-5d69-4613-b7a3-d26f2dedc98e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:57.329652 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-27890154-5d69-4613-b7a3-d26f2dedc98e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:57.330088 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-27890154-5d69-4613-b7a3-d26f2dedc98e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:57.330853 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-27890154-5d69-4613-b7a3-d26f2dedc98e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:57.331279 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-27890154-5d69-4613-b7a3-d26f2dedc98e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:57.497505 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-27890154-5d69-4613-b7a3-d26f2dedc98e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.178443 Dec 27 14:23:57.498151 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 297/557] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:57 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:23:57.799766 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-281e5a8a-f0af-4543-a382-65bd584fc6d9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:57.800402 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-281e5a8a-f0af-4543-a382-65bd584fc6d9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:57.807273 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-281e5a8a-f0af-4543-a382-65bd584fc6d9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:57.807716 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-281e5a8a-f0af-4543-a382-65bd584fc6d9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:57.808527 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-281e5a8a-f0af-4543-a382-65bd584fc6d9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:57.808956 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-281e5a8a-f0af-4543-a382-65bd584fc6d9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:57.941883 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-281e5a8a-f0af-4543-a382-65bd584fc6d9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:57.950540 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-281e5a8a-f0af-4543-a382-65bd584fc6d9 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.154960 Dec 27 14:23:57.951183 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 261/558] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:57 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:23:57.979426 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f1e1232f-3924-4d94-8a46-47c3f209d67b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:57.980597 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f1e1232f-3924-4d94-8a46-47c3f209d67b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:57.987444 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f1e1232f-3924-4d94-8a46-47c3f209d67b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:57.987921 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f1e1232f-3924-4d94-8a46-47c3f209d67b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:57.988702 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f1e1232f-3924-4d94-8a46-47c3f209d67b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:57.989130 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f1e1232f-3924-4d94-8a46-47c3f209d67b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:58.102750 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f1e1232f-3924-4d94-8a46-47c3f209d67b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 31812 microversion: 2.1 time: 0.127195 Dec 27 14:23:58.103293 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 298/559] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:57 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 31812 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:23:58.509163 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5e6167ee-8329-4dfb-bbfe-2f88b0c5b89d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:58.510097 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5e6167ee-8329-4dfb-bbfe-2f88b0c5b89d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:58.516645 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e6167ee-8329-4dfb-bbfe-2f88b0c5b89d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:58.517089 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e6167ee-8329-4dfb-bbfe-2f88b0c5b89d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:58.517891 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e6167ee-8329-4dfb-bbfe-2f88b0c5b89d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:58.518372 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5e6167ee-8329-4dfb-bbfe-2f88b0c5b89d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:58.625766 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5e6167ee-8329-4dfb-bbfe-2f88b0c5b89d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.120275 Dec 27 14:23:58.626431 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 262/560] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:58 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:23:58.967869 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d0089ac7-5152-4faa-a5ee-a6ee4a13beaf tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:23:58.968564 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d0089ac7-5152-4faa-a5ee-a6ee4a13beaf tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:58.975375 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d0089ac7-5152-4faa-a5ee-a6ee4a13beaf tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:58.975823 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d0089ac7-5152-4faa-a5ee-a6ee4a13beaf tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:58.976636 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d0089ac7-5152-4faa-a5ee-a6ee4a13beaf tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:58.977062 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d0089ac7-5152-4faa-a5ee-a6ee4a13beaf tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:59.113411 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d0089ac7-5152-4faa-a5ee-a6ee4a13beaf tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:23:59.115329 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-af3a2f6e-f09a-45ef-a9ed-2657815bdbd2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:59.117413 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-af3a2f6e-f09a-45ef-a9ed-2657815bdbd2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:59.122414 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d0089ac7-5152-4faa-a5ee-a6ee4a13beaf tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.158441 Dec 27 14:23:59.122994 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 299/561] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:23:58 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:23:59.124448 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-af3a2f6e-f09a-45ef-a9ed-2657815bdbd2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:59.125112 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-af3a2f6e-f09a-45ef-a9ed-2657815bdbd2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:59.126105 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-af3a2f6e-f09a-45ef-a9ed-2657815bdbd2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:59.126700 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-af3a2f6e-f09a-45ef-a9ed-2657815bdbd2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:59.251704 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-af3a2f6e-f09a-45ef-a9ed-2657815bdbd2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 32571 microversion: 2.1 time: 0.140807 Dec 27 14:23:59.252293 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 263/562] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:23:59 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 32571 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:23:59.636755 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-29767601-453a-4ff4-8df0-f941304fa1fb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:23:59.637670 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-29767601-453a-4ff4-8df0-f941304fa1fb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:23:59.643865 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-29767601-453a-4ff4-8df0-f941304fa1fb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:59.644314 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-29767601-453a-4ff4-8df0-f941304fa1fb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:59.645077 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-29767601-453a-4ff4-8df0-f941304fa1fb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:23:59.645508 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-29767601-453a-4ff4-8df0-f941304fa1fb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:23:59.742518 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-29767601-453a-4ff4-8df0-f941304fa1fb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.108428 Dec 27 14:23:59.743404 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 300/563] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:23:59 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:00.140051 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6d1fb8c8-4fbb-42d4-b200-190424100b21 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:00.140662 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6d1fb8c8-4fbb-42d4-b200-190424100b21 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:00.147515 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d1fb8c8-4fbb-42d4-b200-190424100b21 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:00.148164 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d1fb8c8-4fbb-42d4-b200-190424100b21 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:00.148960 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d1fb8c8-4fbb-42d4-b200-190424100b21 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:00.149389 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d1fb8c8-4fbb-42d4-b200-190424100b21 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:00.263718 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-af25864e-f23a-45c2-9ba5-b893625787cf tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:00.265080 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-af25864e-f23a-45c2-9ba5-b893625787cf tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:00.271927 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-af25864e-f23a-45c2-9ba5-b893625787cf tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:00.272408 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-af25864e-f23a-45c2-9ba5-b893625787cf tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:00.273388 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-af25864e-f23a-45c2-9ba5-b893625787cf tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:00.273828 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-af25864e-f23a-45c2-9ba5-b893625787cf tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:00.280710 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6d1fb8c8-4fbb-42d4-b200-190424100b21 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:00.289779 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6d1fb8c8-4fbb-42d4-b200-190424100b21 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.153881 Dec 27 14:24:00.290342 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 264/564] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:00 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:00.418452 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b15b8b19-51fb-4d37-8699-1562bcef41f3 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9da66eb4-e820-4311-b48d-86da94e1fd7f", "device": "/dev/sdb"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:00.419774 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-af25864e-f23a-45c2-9ba5-b893625787cf tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 33011 microversion: 2.1 time: 0.160295 Dec 27 14:24:00.420024 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b15b8b19-51fb-4d37-8699-1562bcef41f3 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:00.424025 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 301/565] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:24:00 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 33011 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:24:00.426307 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b15b8b19-51fb-4d37-8699-1562bcef41f3 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:00.426756 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b15b8b19-51fb-4d37-8699-1562bcef41f3 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:00.427533 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b15b8b19-51fb-4d37-8699-1562bcef41f3 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:00.427995 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b15b8b19-51fb-4d37-8699-1562bcef41f3 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:00.678842 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b15b8b19-51fb-4d37-8699-1562bcef41f3 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "POST /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263892 Dec 27 14:24:00.680118 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 265/566] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Dec 27 14:24:00 2021] POST /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:24:00.755188 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9fb4dff2-3ae6-41b3-ac67-dfd7a0759e0c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:00.756237 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9fb4dff2-3ae6-41b3-ac67-dfd7a0759e0c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:00.763407 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9fb4dff2-3ae6-41b3-ac67-dfd7a0759e0c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:00.763907 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9fb4dff2-3ae6-41b3-ac67-dfd7a0759e0c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:00.764712 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9fb4dff2-3ae6-41b3-ac67-dfd7a0759e0c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:00.765127 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9fb4dff2-3ae6-41b3-ac67-dfd7a0759e0c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:00.891790 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9fb4dff2-3ae6-41b3-ac67-dfd7a0759e0c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.140646 Dec 27 14:24:00.895514 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 302/567] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:00 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:01.307045 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3f9f38ae-e380-4c89-80d0-347c1dca04ee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:01.307738 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3f9f38ae-e380-4c89-80d0-347c1dca04ee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:01.314481 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3f9f38ae-e380-4c89-80d0-347c1dca04ee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:01.314927 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3f9f38ae-e380-4c89-80d0-347c1dca04ee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:01.315698 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3f9f38ae-e380-4c89-80d0-347c1dca04ee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:01.316161 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3f9f38ae-e380-4c89-80d0-347c1dca04ee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:01.432195 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a00e920c-fc03-46f4-91a3-518616fd28d1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:01.433330 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a00e920c-fc03-46f4-91a3-518616fd28d1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:01.440730 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a00e920c-fc03-46f4-91a3-518616fd28d1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:01.441183 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a00e920c-fc03-46f4-91a3-518616fd28d1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:01.441985 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a00e920c-fc03-46f4-91a3-518616fd28d1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:01.442422 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a00e920c-fc03-46f4-91a3-518616fd28d1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:01.451368 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3f9f38ae-e380-4c89-80d0-347c1dca04ee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:01.459262 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3f9f38ae-e380-4c89-80d0-347c1dca04ee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.156381 Dec 27 14:24:01.459860 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 266/568] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:01 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:01.567283 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a00e920c-fc03-46f4-91a3-518616fd28d1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 33349 microversion: 2.1 time: 0.139119 Dec 27 14:24:01.568610 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 303/569] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:24:01 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 33349 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:24:01.903379 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-47199d20-3f81-4875-b669-80eecaf0365c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:01.904354 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-47199d20-3f81-4875-b669-80eecaf0365c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:01.910940 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47199d20-3f81-4875-b669-80eecaf0365c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:01.911335 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47199d20-3f81-4875-b669-80eecaf0365c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:01.912206 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47199d20-3f81-4875-b669-80eecaf0365c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:01.912643 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-47199d20-3f81-4875-b669-80eecaf0365c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:02.002324 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-47199d20-3f81-4875-b669-80eecaf0365c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.102589 Dec 27 14:24:02.003140 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 267/570] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:01 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:02.477733 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-04609e52-1bf5-43a6-9485-c7fa6debed05 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:02.478566 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-04609e52-1bf5-43a6-9485-c7fa6debed05 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:02.485615 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-04609e52-1bf5-43a6-9485-c7fa6debed05 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:02.486072 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-04609e52-1bf5-43a6-9485-c7fa6debed05 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:02.486859 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-04609e52-1bf5-43a6-9485-c7fa6debed05 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:02.487301 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-04609e52-1bf5-43a6-9485-c7fa6debed05 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:02.580437 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-17035553-cf7b-4714-9313-e3dfe98c3c57 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:02.581481 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-17035553-cf7b-4714-9313-e3dfe98c3c57 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:02.589307 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17035553-cf7b-4714-9313-e3dfe98c3c57 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:02.589760 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17035553-cf7b-4714-9313-e3dfe98c3c57 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:02.590553 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17035553-cf7b-4714-9313-e3dfe98c3c57 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:02.590986 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17035553-cf7b-4714-9313-e3dfe98c3c57 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:02.617499 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-04609e52-1bf5-43a6-9485-c7fa6debed05 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:02.626060 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-04609e52-1bf5-43a6-9485-c7fa6debed05 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.152370 Dec 27 14:24:02.626740 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 304/571] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:02 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:02.692098 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-17035553-cf7b-4714-9313-e3dfe98c3c57 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 33688 microversion: 2.1 time: 0.115542 Dec 27 14:24:02.694043 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 268/572] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:24:02 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 33688 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:24:02.803223 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9a2e2d97-e5ad-47cb-b159-2873ccd88138 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:02.803728 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9a2e2d97-e5ad-47cb-b159-2873ccd88138 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:02.810631 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a2e2d97-e5ad-47cb-b159-2873ccd88138 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:02.811085 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a2e2d97-e5ad-47cb-b159-2873ccd88138 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:02.811940 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a2e2d97-e5ad-47cb-b159-2873ccd88138 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:02.812377 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a2e2d97-e5ad-47cb-b159-2873ccd88138 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:02.932549 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.objects.instance [None req-9a2e2d97-e5ad-47cb-b159-2873ccd88138 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lazy-loading 'services' on Instance uuid b9463099-568c-4c60-a669-3cd59a85b759 {{(pid=116105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:24:03.014566 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9131e0ff-c3c0-48c8-8e43-e7eb9590f96f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:03.015563 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9131e0ff-c3c0-48c8-8e43-e7eb9590f96f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:03.023626 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9131e0ff-c3c0-48c8-8e43-e7eb9590f96f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:03.024199 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9131e0ff-c3c0-48c8-8e43-e7eb9590f96f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:03.024992 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9131e0ff-c3c0-48c8-8e43-e7eb9590f96f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:03.025421 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9131e0ff-c3c0-48c8-8e43-e7eb9590f96f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:03.041676 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9a2e2d97-e5ad-47cb-b159-2873ccd88138 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "DELETE /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments/3b135bcb-7450-4ade-a7ef-9148ea426d58" status: 202 len: 0 microversion: 2.1 time: 0.241962 Dec 27 14:24:03.042347 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 305/573] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Dec 27 14:24:02 2021] DELETE /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments/3b135bcb-7450-4ade-a7ef-9148ea426d58 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:03.050875 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c971431a-fdb3-4a14-957e-5e5ecff15aa4 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:03.051975 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c971431a-fdb3-4a14-957e-5e5ecff15aa4 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:03.058851 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c971431a-fdb3-4a14-957e-5e5ecff15aa4 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:03.059564 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c971431a-fdb3-4a14-957e-5e5ecff15aa4 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:03.060567 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c971431a-fdb3-4a14-957e-5e5ecff15aa4 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:03.061264 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c971431a-fdb3-4a14-957e-5e5ecff15aa4 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:03.093484 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c971431a-fdb3-4a14-957e-5e5ecff15aa4 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046522 Dec 27 14:24:03.094057 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 306/574] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:24:03 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:24:03.108922 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9131e0ff-c3c0-48c8-8e43-e7eb9590f96f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.097868 Dec 27 14:24:03.109558 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 269/575] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:03 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:24:03.644235 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1f2ee183-5d14-4a70-aa92-f8f0e3aea6b2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:03.644773 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1f2ee183-5d14-4a70-aa92-f8f0e3aea6b2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:03.651551 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1f2ee183-5d14-4a70-aa92-f8f0e3aea6b2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:03.652036 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1f2ee183-5d14-4a70-aa92-f8f0e3aea6b2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:03.652814 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1f2ee183-5d14-4a70-aa92-f8f0e3aea6b2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:03.653247 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1f2ee183-5d14-4a70-aa92-f8f0e3aea6b2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:03.704290 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d1973c01-4117-4619-83fa-5356bf9d8250 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:03.705288 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d1973c01-4117-4619-83fa-5356bf9d8250 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:03.712968 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1973c01-4117-4619-83fa-5356bf9d8250 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:03.713414 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1973c01-4117-4619-83fa-5356bf9d8250 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:03.714202 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1973c01-4117-4619-83fa-5356bf9d8250 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:03.714633 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1973c01-4117-4619-83fa-5356bf9d8250 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:03.790650 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1f2ee183-5d14-4a70-aa92-f8f0e3aea6b2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:03.798615 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1f2ee183-5d14-4a70-aa92-f8f0e3aea6b2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.158074 Dec 27 14:24:03.799427 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 307/576] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:03 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:03.801638 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d1973c01-4117-4619-83fa-5356bf9d8250 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 34413 microversion: 2.1 time: 0.101175 Dec 27 14:24:03.802492 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 270/577] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:24:03 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 34413 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:24:04.106099 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-aa7ed5cd-2649-4c8f-894b-f417198eef28 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:04.107011 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-aa7ed5cd-2649-4c8f-894b-f417198eef28 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:04.112944 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa7ed5cd-2649-4c8f-894b-f417198eef28 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:04.113388 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa7ed5cd-2649-4c8f-894b-f417198eef28 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:04.114193 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa7ed5cd-2649-4c8f-894b-f417198eef28 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:04.114622 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa7ed5cd-2649-4c8f-894b-f417198eef28 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:04.121877 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fbb7b7e0-5eca-4bb0-a619-cad84dbe2085 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:04.122909 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fbb7b7e0-5eca-4bb0-a619-cad84dbe2085 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:04.129869 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fbb7b7e0-5eca-4bb0-a619-cad84dbe2085 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:04.130317 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fbb7b7e0-5eca-4bb0-a619-cad84dbe2085 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:04.131239 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fbb7b7e0-5eca-4bb0-a619-cad84dbe2085 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:04.131561 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fbb7b7e0-5eca-4bb0-a619-cad84dbe2085 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:04.144539 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-aa7ed5cd-2649-4c8f-894b-f417198eef28 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042064 Dec 27 14:24:04.145246 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 308/578] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:24:04 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:24:04.211951 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fbb7b7e0-5eca-4bb0-a619-cad84dbe2085 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.094808 Dec 27 14:24:04.212652 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 271/579] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:04 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:04.813084 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-821bdc36-176c-4781-b5d6-8e08fc48695d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:04.813996 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-821bdc36-176c-4781-b5d6-8e08fc48695d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:04.816234 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2cefbbab-446d-4e22-ba89-ba0f4b9a7d3d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:04.816938 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2cefbbab-446d-4e22-ba89-ba0f4b9a7d3d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:04.821047 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-821bdc36-176c-4781-b5d6-8e08fc48695d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:04.821494 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-821bdc36-176c-4781-b5d6-8e08fc48695d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:04.822271 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-821bdc36-176c-4781-b5d6-8e08fc48695d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:04.822714 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-821bdc36-176c-4781-b5d6-8e08fc48695d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:04.824886 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cefbbab-446d-4e22-ba89-ba0f4b9a7d3d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:04.825527 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cefbbab-446d-4e22-ba89-ba0f4b9a7d3d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:04.826481 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cefbbab-446d-4e22-ba89-ba0f4b9a7d3d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:04.827069 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2cefbbab-446d-4e22-ba89-ba0f4b9a7d3d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:04.908355 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-821bdc36-176c-4781-b5d6-8e08fc48695d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 35055 microversion: 2.1 time: 0.098459 Dec 27 14:24:04.908993 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 309/580] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:24:04 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 35055 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:24:04.959649 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2cefbbab-446d-4e22-ba89-ba0f4b9a7d3d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:04.968734 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2cefbbab-446d-4e22-ba89-ba0f4b9a7d3d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.156471 Dec 27 14:24:04.969295 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 272/581] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:04 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:05.157398 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a60c520a-6c0d-446f-a672-f15e18c9c74b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:05.158470 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a60c520a-6c0d-446f-a672-f15e18c9c74b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:05.165353 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a60c520a-6c0d-446f-a672-f15e18c9c74b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:05.165808 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a60c520a-6c0d-446f-a672-f15e18c9c74b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:05.167378 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a60c520a-6c0d-446f-a672-f15e18c9c74b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:05.167817 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a60c520a-6c0d-446f-a672-f15e18c9c74b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:05.198684 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a60c520a-6c0d-446f-a672-f15e18c9c74b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045611 Dec 27 14:24:05.199242 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 310/582] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:24:05 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:24:05.223636 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6f125308-f490-405d-85f6-1e68ee7588eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:05.224626 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6f125308-f490-405d-85f6-1e68ee7588eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:05.231738 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f125308-f490-405d-85f6-1e68ee7588eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:05.232213 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f125308-f490-405d-85f6-1e68ee7588eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:05.233019 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f125308-f490-405d-85f6-1e68ee7588eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:05.233461 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6f125308-f490-405d-85f6-1e68ee7588eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:05.301875 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6f125308-f490-405d-85f6-1e68ee7588eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.081916 Dec 27 14:24:05.302792 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 273/583] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:05 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:05.920690 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e238683b-b121-4527-ab07-0a1e21097eb8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:05.921513 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e238683b-b121-4527-ab07-0a1e21097eb8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:05.927815 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e238683b-b121-4527-ab07-0a1e21097eb8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:05.928294 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e238683b-b121-4527-ab07-0a1e21097eb8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:05.929065 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e238683b-b121-4527-ab07-0a1e21097eb8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:05.929501 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e238683b-b121-4527-ab07-0a1e21097eb8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:05.986760 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9917da85-0ab1-40e6-aaf0-bba0d329e0b1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:05.987519 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9917da85-0ab1-40e6-aaf0-bba0d329e0b1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:05.994666 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9917da85-0ab1-40e6-aaf0-bba0d329e0b1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:05.995286 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9917da85-0ab1-40e6-aaf0-bba0d329e0b1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:05.996230 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9917da85-0ab1-40e6-aaf0-bba0d329e0b1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:05.996699 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9917da85-0ab1-40e6-aaf0-bba0d329e0b1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:06.023106 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e238683b-b121-4527-ab07-0a1e21097eb8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 35976 microversion: 2.1 time: 0.106657 Dec 27 14:24:06.027888 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 311/584] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:24:05 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 35976 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:24:06.131468 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9917da85-0ab1-40e6-aaf0-bba0d329e0b1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:06.140219 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9917da85-0ab1-40e6-aaf0-bba0d329e0b1 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.157460 Dec 27 14:24:06.140797 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 274/585] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:05 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:06.210633 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-cc523a26-fe83-414c-9dae-24f3ead385ae tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:06.211640 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-cc523a26-fe83-414c-9dae-24f3ead385ae tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:06.219178 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc523a26-fe83-414c-9dae-24f3ead385ae tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:06.219641 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc523a26-fe83-414c-9dae-24f3ead385ae tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:06.220449 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc523a26-fe83-414c-9dae-24f3ead385ae tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:06.220887 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc523a26-fe83-414c-9dae-24f3ead385ae tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:06.250168 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-cc523a26-fe83-414c-9dae-24f3ead385ae tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043614 Dec 27 14:24:06.250706 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 312/586] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:24:06 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:24:06.313215 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9e83ab7d-28fd-47fd-8fbb-493e4d4be0cc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:06.314164 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9e83ab7d-28fd-47fd-8fbb-493e4d4be0cc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:06.320603 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e83ab7d-28fd-47fd-8fbb-493e4d4be0cc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:06.321049 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e83ab7d-28fd-47fd-8fbb-493e4d4be0cc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:06.321828 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e83ab7d-28fd-47fd-8fbb-493e4d4be0cc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:06.322260 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9e83ab7d-28fd-47fd-8fbb-493e4d4be0cc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:06.411806 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9e83ab7d-28fd-47fd-8fbb-493e4d4be0cc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.102091 Dec 27 14:24:06.412476 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 275/587] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:06 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:07.035756 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-bd38bc27-562d-4252-9791-fa8dc0c56af4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:07.036706 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-bd38bc27-562d-4252-9791-fa8dc0c56af4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:07.042996 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bd38bc27-562d-4252-9791-fa8dc0c56af4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:07.043636 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bd38bc27-562d-4252-9791-fa8dc0c56af4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:07.044511 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bd38bc27-562d-4252-9791-fa8dc0c56af4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:07.044952 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bd38bc27-562d-4252-9791-fa8dc0c56af4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:07.138856 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-bd38bc27-562d-4252-9791-fa8dc0c56af4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 36839 microversion: 2.1 time: 0.106622 Dec 27 14:24:07.143392 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 313/588] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:24:07 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 36839 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:24:07.158520 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-60245059-3459-403f-9f4b-0007341a0633 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:07.159221 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-60245059-3459-403f-9f4b-0007341a0633 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:07.166566 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60245059-3459-403f-9f4b-0007341a0633 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:07.167018 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60245059-3459-403f-9f4b-0007341a0633 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:07.167810 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60245059-3459-403f-9f4b-0007341a0633 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:07.168312 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60245059-3459-403f-9f4b-0007341a0633 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:07.262632 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b3b2e6e6-ed13-4bb4-8203-22ef53a6ecf1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:07.263539 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b3b2e6e6-ed13-4bb4-8203-22ef53a6ecf1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:07.270373 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b3b2e6e6-ed13-4bb4-8203-22ef53a6ecf1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:07.270824 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b3b2e6e6-ed13-4bb4-8203-22ef53a6ecf1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:07.271611 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b3b2e6e6-ed13-4bb4-8203-22ef53a6ecf1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:07.272073 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b3b2e6e6-ed13-4bb4-8203-22ef53a6ecf1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:07.302929 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-60245059-3459-403f-9f4b-0007341a0633 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:07.303613 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b3b2e6e6-ed13-4bb4-8203-22ef53a6ecf1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045640 Dec 27 14:24:07.304231 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 314/589] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:24:07 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:24:07.310845 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-60245059-3459-403f-9f4b-0007341a0633 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.156727 Dec 27 14:24:07.311409 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 276/590] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:07 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:07.423385 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-bd2e6c40-8d26-47fb-9a1c-2f769063a341 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:07.424353 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-bd2e6c40-8d26-47fb-9a1c-2f769063a341 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:07.430646 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bd2e6c40-8d26-47fb-9a1c-2f769063a341 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:07.431098 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bd2e6c40-8d26-47fb-9a1c-2f769063a341 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:07.431902 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bd2e6c40-8d26-47fb-9a1c-2f769063a341 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:07.432340 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bd2e6c40-8d26-47fb-9a1c-2f769063a341 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:07.526731 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-bd2e6c40-8d26-47fb-9a1c-2f769063a341 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.106833 Dec 27 14:24:07.527610 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 315/591] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:07 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:08.151234 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3ec6f6fe-f9dc-415a-ae09-bbaff4e7a52a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:08.152704 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3ec6f6fe-f9dc-415a-ae09-bbaff4e7a52a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:08.159579 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3ec6f6fe-f9dc-415a-ae09-bbaff4e7a52a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:08.160189 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3ec6f6fe-f9dc-415a-ae09-bbaff4e7a52a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:08.160869 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3ec6f6fe-f9dc-415a-ae09-bbaff4e7a52a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:08.161940 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3ec6f6fe-f9dc-415a-ae09-bbaff4e7a52a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:08.292191 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3ec6f6fe-f9dc-415a-ae09-bbaff4e7a52a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 37729 microversion: 2.1 time: 0.144441 Dec 27 14:24:08.294022 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 277/592] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:24:08 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 37729 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:24:08.315222 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3e5c1144-ad90-4590-bc1a-9ecff21792c0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:08.316164 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3e5c1144-ad90-4590-bc1a-9ecff21792c0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:08.323499 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3e5c1144-ad90-4590-bc1a-9ecff21792c0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:08.324916 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3e5c1144-ad90-4590-bc1a-9ecff21792c0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:08.325953 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3e5c1144-ad90-4590-bc1a-9ecff21792c0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:08.326392 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3e5c1144-ad90-4590-bc1a-9ecff21792c0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:08.328747 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c7a7f828-39f7-46f7-aeec-211b1d6869ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:08.329590 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c7a7f828-39f7-46f7-aeec-211b1d6869ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:08.336674 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c7a7f828-39f7-46f7-aeec-211b1d6869ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:08.337131 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c7a7f828-39f7-46f7-aeec-211b1d6869ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:08.337930 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c7a7f828-39f7-46f7-aeec-211b1d6869ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:08.338374 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c7a7f828-39f7-46f7-aeec-211b1d6869ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:08.358343 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3e5c1144-ad90-4590-bc1a-9ecff21792c0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047334 Dec 27 14:24:08.358916 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 316/593] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:24:08 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:24:08.470346 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c7a7f828-39f7-46f7-aeec-211b1d6869ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:08.478696 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c7a7f828-39f7-46f7-aeec-211b1d6869ad tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.154966 Dec 27 14:24:08.479265 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 278/594] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:08 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:08.538358 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-bacc3694-34f0-465e-b12b-08d8566fb3b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:08.539304 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-bacc3694-34f0-465e-b12b-08d8566fb3b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:08.546379 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bacc3694-34f0-465e-b12b-08d8566fb3b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:08.546845 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bacc3694-34f0-465e-b12b-08d8566fb3b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:08.547633 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bacc3694-34f0-465e-b12b-08d8566fb3b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:08.548103 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bacc3694-34f0-465e-b12b-08d8566fb3b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:08.624796 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-bacc3694-34f0-465e-b12b-08d8566fb3b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.089879 Dec 27 14:24:08.625338 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 317/595] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:08 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:09.304417 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ca6dab37-006c-46f4-b5ca-909526ca7fb5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:09.305347 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ca6dab37-006c-46f4-b5ca-909526ca7fb5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:09.312405 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca6dab37-006c-46f4-b5ca-909526ca7fb5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:09.313031 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca6dab37-006c-46f4-b5ca-909526ca7fb5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:09.314073 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca6dab37-006c-46f4-b5ca-909526ca7fb5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:09.314524 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca6dab37-006c-46f4-b5ca-909526ca7fb5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:09.370490 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-24f96483-83a9-4350-ad6d-c043dd0ff5fb tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:09.372117 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-24f96483-83a9-4350-ad6d-c043dd0ff5fb tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:09.379249 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24f96483-83a9-4350-ad6d-c043dd0ff5fb tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:09.379698 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24f96483-83a9-4350-ad6d-c043dd0ff5fb tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:09.380843 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24f96483-83a9-4350-ad6d-c043dd0ff5fb tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:09.381280 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24f96483-83a9-4350-ad6d-c043dd0ff5fb tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:09.412257 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-24f96483-83a9-4350-ad6d-c043dd0ff5fb tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046291 Dec 27 14:24:09.412810 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 318/596] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:24:09 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:24:09.423574 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ca6dab37-006c-46f4-b5ca-909526ca7fb5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 38100 microversion: 2.1 time: 0.122580 Dec 27 14:24:09.425788 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 279/597] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:24:09 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 38100 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:24:09.496595 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c77f5265-5b2f-47f0-88a5-7286856d7f4b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:09.497234 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c77f5265-5b2f-47f0-88a5-7286856d7f4b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:09.503513 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c77f5265-5b2f-47f0-88a5-7286856d7f4b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:09.504000 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c77f5265-5b2f-47f0-88a5-7286856d7f4b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:09.504779 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c77f5265-5b2f-47f0-88a5-7286856d7f4b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:09.505215 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c77f5265-5b2f-47f0-88a5-7286856d7f4b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:09.637287 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-169ca718-f757-4747-a1d4-153175cac498 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:09.638238 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-169ca718-f757-4747-a1d4-153175cac498 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:09.642331 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c77f5265-5b2f-47f0-88a5-7286856d7f4b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:09.644824 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-169ca718-f757-4747-a1d4-153175cac498 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:09.645320 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-169ca718-f757-4747-a1d4-153175cac498 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:09.646155 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-169ca718-f757-4747-a1d4-153175cac498 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:09.646637 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-169ca718-f757-4747-a1d4-153175cac498 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:09.650373 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c77f5265-5b2f-47f0-88a5-7286856d7f4b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.158049 Dec 27 14:24:09.651031 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 319/598] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:09 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:09.741696 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-169ca718-f757-4747-a1d4-153175cac498 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.109461 Dec 27 14:24:09.742382 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 280/599] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:09 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:24:10.424485 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3ea09374-c0a0-4a76-b911-0ab24cb8f71b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:10.425331 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3ea09374-c0a0-4a76-b911-0ab24cb8f71b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:10.432003 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3ea09374-c0a0-4a76-b911-0ab24cb8f71b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:10.432464 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3ea09374-c0a0-4a76-b911-0ab24cb8f71b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:10.433596 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3ea09374-c0a0-4a76-b911-0ab24cb8f71b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:10.434037 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3ea09374-c0a0-4a76-b911-0ab24cb8f71b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:10.435676 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b9cb1db1-0100-4b9c-9bc7-ed1b0799424c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:10.436942 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b9cb1db1-0100-4b9c-9bc7-ed1b0799424c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:10.443726 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9cb1db1-0100-4b9c-9bc7-ed1b0799424c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:10.444220 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9cb1db1-0100-4b9c-9bc7-ed1b0799424c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:10.445006 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9cb1db1-0100-4b9c-9bc7-ed1b0799424c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:10.445433 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b9cb1db1-0100-4b9c-9bc7-ed1b0799424c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:10.463372 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3ea09374-c0a0-4a76-b911-0ab24cb8f71b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042651 Dec 27 14:24:10.463978 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 320/600] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:24:10 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:24:10.668335 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-62bc1a7f-2de3-4fb4-b6d4-b2ed7fd7cf6c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:10.669067 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-62bc1a7f-2de3-4fb4-b6d4-b2ed7fd7cf6c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:10.675010 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-62bc1a7f-2de3-4fb4-b6d4-b2ed7fd7cf6c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:10.675404 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-62bc1a7f-2de3-4fb4-b6d4-b2ed7fd7cf6c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:10.676212 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-62bc1a7f-2de3-4fb4-b6d4-b2ed7fd7cf6c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:10.676646 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-62bc1a7f-2de3-4fb4-b6d4-b2ed7fd7cf6c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:10.805219 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-62bc1a7f-2de3-4fb4-b6d4-b2ed7fd7cf6c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:10.813696 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-62bc1a7f-2de3-4fb4-b6d4-b2ed7fd7cf6c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.149758 Dec 27 14:24:10.814260 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 321/601] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:10 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:10.818534 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-13d7c33e-2055-4590-9e2f-10735ef3cc18 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:10.819451 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-13d7c33e-2055-4590-9e2f-10735ef3cc18 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:10.825298 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-13d7c33e-2055-4590-9e2f-10735ef3cc18 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:10.825765 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-13d7c33e-2055-4590-9e2f-10735ef3cc18 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:10.826528 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-13d7c33e-2055-4590-9e2f-10735ef3cc18 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:10.826971 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-13d7c33e-2055-4590-9e2f-10735ef3cc18 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:14.675016 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b9cb1db1-0100-4b9c-9bc7-ed1b0799424c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 38100 microversion: 2.1 time: 4.243287 Dec 27 14:24:14.676181 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 281/602] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:24:10 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 38100 bytes in 4245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:24:14.682284 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-98f32037-4130-4bc5-bb0e-b8bc680931cb tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:14.684234 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-98f32037-4130-4bc5-bb0e-b8bc680931cb tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:14.685834 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-13d7c33e-2055-4590-9e2f-10735ef3cc18 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 3.870259 Dec 27 14:24:14.689008 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 322/603] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:10 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 3872 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:14.692431 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-98f32037-4130-4bc5-bb0e-b8bc680931cb tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:14.692888 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-98f32037-4130-4bc5-bb0e-b8bc680931cb tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:14.693061 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-91d2e546-877d-4075-90f1-f181f1dc006a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:14.693673 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-98f32037-4130-4bc5-bb0e-b8bc680931cb tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:14.694032 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-91d2e546-877d-4075-90f1-f181f1dc006a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:14.694128 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-98f32037-4130-4bc5-bb0e-b8bc680931cb tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:14.702906 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-91d2e546-877d-4075-90f1-f181f1dc006a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:14.703354 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-91d2e546-877d-4075-90f1-f181f1dc006a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:14.704373 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-91d2e546-877d-4075-90f1-f181f1dc006a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:14.704810 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-91d2e546-877d-4075-90f1-f181f1dc006a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:14.723660 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-98f32037-4130-4bc5-bb0e-b8bc680931cb tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046186 Dec 27 14:24:14.724177 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 282/604] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:24:14 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:24:14.843208 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-91d2e546-877d-4075-90f1-f181f1dc006a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:14.851439 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-91d2e546-877d-4075-90f1-f181f1dc006a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.162922 Dec 27 14:24:14.852101 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 323/605] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:14 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:15.687757 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-27e45bad-6c1e-4286-bdae-27885359a422 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:15.688689 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-27e45bad-6c1e-4286-bdae-27885359a422 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:15.694532 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-27e45bad-6c1e-4286-bdae-27885359a422 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:15.694985 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-27e45bad-6c1e-4286-bdae-27885359a422 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:15.695766 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-27e45bad-6c1e-4286-bdae-27885359a422 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:15.696229 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-27e45bad-6c1e-4286-bdae-27885359a422 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:15.697452 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-571c5d06-a487-4728-9394-3e1bb5fd653f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:15.699040 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-571c5d06-a487-4728-9394-3e1bb5fd653f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:15.705409 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-571c5d06-a487-4728-9394-3e1bb5fd653f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:15.705857 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-571c5d06-a487-4728-9394-3e1bb5fd653f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:15.706631 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-571c5d06-a487-4728-9394-3e1bb5fd653f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:15.707057 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-571c5d06-a487-4728-9394-3e1bb5fd653f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:15.770444 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-27e45bad-6c1e-4286-bdae-27885359a422 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 38100 microversion: 2.1 time: 0.087290 Dec 27 14:24:15.770993 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 283/606] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:24:15 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 38100 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:24:15.776206 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d49a674d-0910-4735-a141-03c971c61bc3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:15.777197 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d49a674d-0910-4735-a141-03c971c61bc3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:15.784313 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d49a674d-0910-4735-a141-03c971c61bc3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:15.784763 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d49a674d-0910-4735-a141-03c971c61bc3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:15.785535 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d49a674d-0910-4735-a141-03c971c61bc3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:15.785965 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d49a674d-0910-4735-a141-03c971c61bc3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:15.815598 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d49a674d-0910-4735-a141-03c971c61bc3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043258 Dec 27 14:24:15.816189 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 284/607] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:24:15 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 27 14:24:15.816793 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-571c5d06-a487-4728-9394-3e1bb5fd653f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.123127 Dec 27 14:24:15.817444 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 324/608] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:15 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:24:15.868773 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e396df15-3e99-4fbf-99ab-748ce61775b5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:15.869378 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e396df15-3e99-4fbf-99ab-748ce61775b5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:15.876836 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e396df15-3e99-4fbf-99ab-748ce61775b5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:15.877217 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e396df15-3e99-4fbf-99ab-748ce61775b5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:15.878006 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e396df15-3e99-4fbf-99ab-748ce61775b5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:15.878439 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e396df15-3e99-4fbf-99ab-748ce61775b5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:16.019869 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e396df15-3e99-4fbf-99ab-748ce61775b5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:16.028266 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e396df15-3e99-4fbf-99ab-748ce61775b5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.162919 Dec 27 14:24:16.028770 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 285/609] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:15 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:16.783093 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2879dfda-7167-4811-97ba-38b15828b036 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:16.784227 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2879dfda-7167-4811-97ba-38b15828b036 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:16.791308 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2879dfda-7167-4811-97ba-38b15828b036 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:16.791761 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2879dfda-7167-4811-97ba-38b15828b036 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:16.793235 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2879dfda-7167-4811-97ba-38b15828b036 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:16.793672 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2879dfda-7167-4811-97ba-38b15828b036 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:16.828745 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3f8de7cd-b00c-47b3-b495-a10c8071da58 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:16.829662 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3f8de7cd-b00c-47b3-b495-a10c8071da58 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:16.836031 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3f8de7cd-b00c-47b3-b495-a10c8071da58 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:16.836484 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3f8de7cd-b00c-47b3-b495-a10c8071da58 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:16.837267 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3f8de7cd-b00c-47b3-b495-a10c8071da58 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:16.838206 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3f8de7cd-b00c-47b3-b495-a10c8071da58 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:21.050639 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2879dfda-7167-4811-97ba-38b15828b036 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 200 len: 38229 microversion: 2.1 time: 4.271546 Dec 27 14:24:21.051204 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 325/610] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:24:16 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 38229 bytes in 4273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:24:21.062359 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2bae2afc-3945-443f-959d-0e4ba99effb2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:21.063547 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2bae2afc-3945-443f-959d-0e4ba99effb2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:21.070780 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2bae2afc-3945-443f-959d-0e4ba99effb2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:21.071225 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2bae2afc-3945-443f-959d-0e4ba99effb2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:21.072054 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2bae2afc-3945-443f-959d-0e4ba99effb2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:21.072535 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2bae2afc-3945-443f-959d-0e4ba99effb2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:21.102162 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3f8de7cd-b00c-47b3-b495-a10c8071da58 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 4.276846 Dec 27 14:24:21.102872 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 286/611] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:16 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 4278 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:24:21.108657 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-264f05e1-8a6b-4685-a7be-6fe28140ba73 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:21.109241 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-264f05e1-8a6b-4685-a7be-6fe28140ba73 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:21.117113 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-264f05e1-8a6b-4685-a7be-6fe28140ba73 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:21.117565 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-264f05e1-8a6b-4685-a7be-6fe28140ba73 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:21.118567 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-264f05e1-8a6b-4685-a7be-6fe28140ba73 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:21.119057 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-264f05e1-8a6b-4685-a7be-6fe28140ba73 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:21.144454 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-264f05e1-8a6b-4685-a7be-6fe28140ba73 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/ips" status: 200 len: 147 microversion: 2.1 time: 0.040436 Dec 27 14:24:21.145471 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 287/612] 10.222.0.37 () {58 vars in 1247 bytes} [Mon Dec 27 14:24:21 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/ips => generated 147 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:24:21.209269 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-2bae2afc-3945-443f-959d-0e4ba99effb2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:21.217183 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2bae2afc-3945-443f-959d-0e4ba99effb2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.164929 Dec 27 14:24:21.217776 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 326/613] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:21 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:22.116230 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-62b69c32-2356-40ec-827c-600dcc3f817a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:22.117153 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-62b69c32-2356-40ec-827c-600dcc3f817a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:22.124462 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62b69c32-2356-40ec-827c-600dcc3f817a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:22.124916 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62b69c32-2356-40ec-827c-600dcc3f817a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:22.125711 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62b69c32-2356-40ec-827c-600dcc3f817a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:22.126148 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62b69c32-2356-40ec-827c-600dcc3f817a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:22.234764 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4c8a0fe3-d7e6-4dc0-81d9-966e220f5158 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:22.235437 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4c8a0fe3-d7e6-4dc0-81d9-966e220f5158 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:22.239985 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-62b69c32-2356-40ec-827c-600dcc3f817a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.127199 Dec 27 14:24:22.241769 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 288/614] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:22 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:22.246360 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4c8a0fe3-d7e6-4dc0-81d9-966e220f5158 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:22.246882 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4c8a0fe3-d7e6-4dc0-81d9-966e220f5158 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:22.247907 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4c8a0fe3-d7e6-4dc0-81d9-966e220f5158 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:22.248410 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4c8a0fe3-d7e6-4dc0-81d9-966e220f5158 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:22.422755 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4c8a0fe3-d7e6-4dc0-81d9-966e220f5158 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:22.431542 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4c8a0fe3-d7e6-4dc0-81d9-966e220f5158 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.200320 Dec 27 14:24:22.432238 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 327/615] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:22 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:23.252599 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d8186ac2-86fa-465c-86d2-388de02fc3dc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:23.253587 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d8186ac2-86fa-465c-86d2-388de02fc3dc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:23.261035 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d8186ac2-86fa-465c-86d2-388de02fc3dc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:23.261488 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d8186ac2-86fa-465c-86d2-388de02fc3dc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:23.262315 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d8186ac2-86fa-465c-86d2-388de02fc3dc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:23.262789 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d8186ac2-86fa-465c-86d2-388de02fc3dc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:23.283123 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1ebffb89-2c76-40c7-8592-c7258210ccd9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:23.283663 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1ebffb89-2c76-40c7-8592-c7258210ccd9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:23.290565 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1ebffb89-2c76-40c7-8592-c7258210ccd9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:23.291014 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1ebffb89-2c76-40c7-8592-c7258210ccd9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:23.292466 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1ebffb89-2c76-40c7-8592-c7258210ccd9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:23.293072 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1ebffb89-2c76-40c7-8592-c7258210ccd9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:23.318130 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1ebffb89-2c76-40c7-8592-c7258210ccd9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Going to try to terminate instance {{(pid=116105) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 27 14:24:23.370099 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d8186ac2-86fa-465c-86d2-388de02fc3dc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.115987 Dec 27 14:24:23.372367 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 289/616] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:23 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:23.404055 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1ebffb89-2c76-40c7-8592-c7258210ccd9 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "DELETE /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759" status: 204 len: 0 microversion: 2.1 time: 0.124011 Dec 27 14:24:23.404639 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 328/617] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Dec 27 14:24:23 2021] DELETE /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 27 14:24:23.413577 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0a6fff56-beed-480b-a9ae-468228d1a0b1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:23.414283 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0a6fff56-beed-480b-a9ae-468228d1a0b1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:23.421963 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0a6fff56-beed-480b-a9ae-468228d1a0b1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:23.422420 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0a6fff56-beed-480b-a9ae-468228d1a0b1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:23.423206 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0a6fff56-beed-480b-a9ae-468228d1a0b1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:23.423647 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0a6fff56-beed-480b-a9ae-468228d1a0b1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:23.450765 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-84c7fe71-11f2-4718-87da-57590491eaa8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:23.451467 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-84c7fe71-11f2-4718-87da-57590491eaa8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:23.458022 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-84c7fe71-11f2-4718-87da-57590491eaa8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:23.458530 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-84c7fe71-11f2-4718-87da-57590491eaa8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:23.459307 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-84c7fe71-11f2-4718-87da-57590491eaa8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:23.459732 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-84c7fe71-11f2-4718-87da-57590491eaa8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:23.561724 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0a6fff56-beed-480b-a9ae-468228d1a0b1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:23.569200 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0a6fff56-beed-480b-a9ae-468228d1a0b1 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759" status: 200 len: 1513 microversion: 2.1 time: 0.159772 Dec 27 14:24:23.569769 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 290/618] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:23 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:23.595430 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-84c7fe71-11f2-4718-87da-57590491eaa8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:23.603328 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-84c7fe71-11f2-4718-87da-57590491eaa8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.156626 Dec 27 14:24:23.603922 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 329/619] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:23 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:24.383487 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e035a2a2-3c97-4763-bd56-fcbac694347b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:24.384492 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e035a2a2-3c97-4763-bd56-fcbac694347b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:24.391113 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e035a2a2-3c97-4763-bd56-fcbac694347b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:24.391627 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e035a2a2-3c97-4763-bd56-fcbac694347b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:24.392450 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e035a2a2-3c97-4763-bd56-fcbac694347b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:24.392891 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e035a2a2-3c97-4763-bd56-fcbac694347b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:24.450952 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8f47f1f2-434f-4a35-8fb6-7d5c9e2fb331 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e397537-fa1a-498a-bee6-6493ab53fcbb"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:24.452069 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8f47f1f2-434f-4a35-8fb6-7d5c9e2fb331 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:24.458425 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f47f1f2-434f-4a35-8fb6-7d5c9e2fb331 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:24.458871 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f47f1f2-434f-4a35-8fb6-7d5c9e2fb331 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:24.459645 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f47f1f2-434f-4a35-8fb6-7d5c9e2fb331 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:24.460111 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f47f1f2-434f-4a35-8fb6-7d5c9e2fb331 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:28.262330 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e035a2a2-3c97-4763-bd56-fcbac694347b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 3.882463 Dec 27 14:24:28.262989 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 291/620] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:24 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 3884 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:28.268017 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-14703420-f7ba-4ccc-984d-caff0ce4b0b5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:28.268720 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-14703420-f7ba-4ccc-984d-caff0ce4b0b5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:28.276983 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-14703420-f7ba-4ccc-984d-caff0ce4b0b5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:28.277615 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-14703420-f7ba-4ccc-984d-caff0ce4b0b5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:28.278426 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-14703420-f7ba-4ccc-984d-caff0ce4b0b5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:28.278855 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-14703420-f7ba-4ccc-984d-caff0ce4b0b5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:28.420630 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8f47f1f2-434f-4a35-8fb6-7d5c9e2fb331 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.973113 Dec 27 14:24:28.422750 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 330/621] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Dec 27 14:24:24 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/os-volume_attachments => generated 194 bytes in 3976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:24:28.429285 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-98dbb126-5f0b-4a47-881c-26e4da50ca39 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:28.430003 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-98dbb126-5f0b-4a47-881c-26e4da50ca39 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:28.435504 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-14703420-f7ba-4ccc-984d-caff0ce4b0b5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:28.438359 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-98dbb126-5f0b-4a47-881c-26e4da50ca39 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:28.438816 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-98dbb126-5f0b-4a47-881c-26e4da50ca39 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:28.439610 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-98dbb126-5f0b-4a47-881c-26e4da50ca39 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:28.440069 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-98dbb126-5f0b-4a47-881c-26e4da50ca39 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:28.457088 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-14703420-f7ba-4ccc-984d-caff0ce4b0b5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759" status: 200 len: 1513 microversion: 2.1 time: 0.192719 Dec 27 14:24:28.461477 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 292/622] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:28 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759 => generated 1513 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:28.626747 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-98dbb126-5f0b-4a47-881c-26e4da50ca39 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:28.634550 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-98dbb126-5f0b-4a47-881c-26e4da50ca39 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.210664 Dec 27 14:24:28.635115 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 331/623] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:28 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:29.274076 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c66e8d0f-fdb4-42d0-b610-3ca72273a17e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:29.274989 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c66e8d0f-fdb4-42d0-b610-3ca72273a17e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:29.282371 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c66e8d0f-fdb4-42d0-b610-3ca72273a17e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:29.282819 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c66e8d0f-fdb4-42d0-b610-3ca72273a17e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:29.283598 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c66e8d0f-fdb4-42d0-b610-3ca72273a17e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:29.284057 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c66e8d0f-fdb4-42d0-b610-3ca72273a17e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:29.349425 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c66e8d0f-fdb4-42d0-b610-3ca72273a17e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.078997 Dec 27 14:24:29.350519 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 293/624] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:29 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:29.474611 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d18c716e-ceec-4858-8958-cf9e6c5f129b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:29.475226 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d18c716e-ceec-4858-8958-cf9e6c5f129b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:29.481598 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d18c716e-ceec-4858-8958-cf9e6c5f129b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:29.482053 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d18c716e-ceec-4858-8958-cf9e6c5f129b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:29.482829 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d18c716e-ceec-4858-8958-cf9e6c5f129b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:29.483288 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d18c716e-ceec-4858-8958-cf9e6c5f129b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:29.619426 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d18c716e-ceec-4858-8958-cf9e6c5f129b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:29.627498 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d18c716e-ceec-4858-8958-cf9e6c5f129b tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759" status: 200 len: 1513 microversion: 2.1 time: 0.156852 Dec 27 14:24:29.628185 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 332/625] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:29 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:29.653284 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7bfdc72b-c9bf-4669-87c0-1de2dd9fa00d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:29.653994 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7bfdc72b-c9bf-4669-87c0-1de2dd9fa00d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:29.661136 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7bfdc72b-c9bf-4669-87c0-1de2dd9fa00d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:29.661593 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7bfdc72b-c9bf-4669-87c0-1de2dd9fa00d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:29.662387 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7bfdc72b-c9bf-4669-87c0-1de2dd9fa00d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:29.662838 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7bfdc72b-c9bf-4669-87c0-1de2dd9fa00d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:29.794066 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7bfdc72b-c9bf-4669-87c0-1de2dd9fa00d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:29.802400 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7bfdc72b-c9bf-4669-87c0-1de2dd9fa00d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.154234 Dec 27 14:24:29.802960 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 294/626] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:29 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:30.361084 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-64648dd7-2a96-41f1-99ca-b16242690c77 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:30.362110 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-64648dd7-2a96-41f1-99ca-b16242690c77 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:30.368485 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-64648dd7-2a96-41f1-99ca-b16242690c77 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:30.368935 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-64648dd7-2a96-41f1-99ca-b16242690c77 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:30.369747 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-64648dd7-2a96-41f1-99ca-b16242690c77 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:30.370406 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-64648dd7-2a96-41f1-99ca-b16242690c77 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:30.644820 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-244911de-25b3-42ff-8f9f-bb1b649fca61 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:30.645450 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-244911de-25b3-42ff-8f9f-bb1b649fca61 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:30.652246 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-244911de-25b3-42ff-8f9f-bb1b649fca61 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:30.652691 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-244911de-25b3-42ff-8f9f-bb1b649fca61 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:30.653461 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-244911de-25b3-42ff-8f9f-bb1b649fca61 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:30.653890 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-244911de-25b3-42ff-8f9f-bb1b649fca61 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:30.780160 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-244911de-25b3-42ff-8f9f-bb1b649fca61 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:30.787668 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-244911de-25b3-42ff-8f9f-bb1b649fca61 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759" status: 200 len: 1513 microversion: 2.1 time: 0.146455 Dec 27 14:24:30.788276 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 295/627] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:30 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:30.819445 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d8f812b7-4af5-4309-a932-3c0adb7a4996 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:30.820006 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d8f812b7-4af5-4309-a932-3c0adb7a4996 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:30.826169 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d8f812b7-4af5-4309-a932-3c0adb7a4996 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:30.826672 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d8f812b7-4af5-4309-a932-3c0adb7a4996 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:30.827452 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d8f812b7-4af5-4309-a932-3c0adb7a4996 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:30.827907 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d8f812b7-4af5-4309-a932-3c0adb7a4996 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:30.958155 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d8f812b7-4af5-4309-a932-3c0adb7a4996 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:30.966412 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d8f812b7-4af5-4309-a932-3c0adb7a4996 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.150362 Dec 27 14:24:30.966978 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 296/628] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:30 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:31.120258 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-64648dd7-2a96-41f1-99ca-b16242690c77 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.762523 Dec 27 14:24:31.121127 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 333/629] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:30 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:31.805453 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0e29fba0-970b-427f-830f-4bee1d01b7ee tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:31.805989 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0e29fba0-970b-427f-830f-4bee1d01b7ee tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:31.813168 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e29fba0-970b-427f-830f-4bee1d01b7ee tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:31.813620 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e29fba0-970b-427f-830f-4bee1d01b7ee tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:31.814417 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e29fba0-970b-427f-830f-4bee1d01b7ee tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:31.814858 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e29fba0-970b-427f-830f-4bee1d01b7ee tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:31.943170 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0e29fba0-970b-427f-830f-4bee1d01b7ee tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:31.951177 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0e29fba0-970b-427f-830f-4bee1d01b7ee tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759" status: 200 len: 1513 microversion: 2.1 time: 0.149565 Dec 27 14:24:31.951742 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 297/630] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:31 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:31.983045 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-23b34207-8d41-4c54-98a2-6e006b62610f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:31.983767 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-23b34207-8d41-4c54-98a2-6e006b62610f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:31.990680 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-23b34207-8d41-4c54-98a2-6e006b62610f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:31.991132 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-23b34207-8d41-4c54-98a2-6e006b62610f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:31.991946 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-23b34207-8d41-4c54-98a2-6e006b62610f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:31.992384 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-23b34207-8d41-4c54-98a2-6e006b62610f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:32.132200 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-18c82df7-b64a-4560-bd81-9a57845aa8f8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:32.133111 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-18c82df7-b64a-4560-bd81-9a57845aa8f8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:32.139571 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18c82df7-b64a-4560-bd81-9a57845aa8f8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:32.140059 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18c82df7-b64a-4560-bd81-9a57845aa8f8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:32.141013 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18c82df7-b64a-4560-bd81-9a57845aa8f8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:32.141451 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18c82df7-b64a-4560-bd81-9a57845aa8f8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:32.207001 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-23b34207-8d41-4c54-98a2-6e006b62610f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:32.217102 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-23b34207-8d41-4c54-98a2-6e006b62610f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.237983 Dec 27 14:24:32.217685 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 334/631] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:31 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:32.257773 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-18c82df7-b64a-4560-bd81-9a57845aa8f8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.129646 Dec 27 14:24:32.259666 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 298/632] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:32 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:32.276871 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-097bc1f0-c5de-44f6-b0c4-6fbaee360165 req-a257de94-31dc-4633-9a27-16dd0df20d14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9463099-568c-4c60-a669-3cd59a85b759", "name": "network-vif-deleted", "tag": "9011f65d-73a4-4471-925a-06f657690c61"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:32.278150 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:24:32.278150 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:24:32.285814 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-097bc1f0-c5de-44f6-b0c4-6fbaee360165 req-a257de94-31dc-4633-9a27-16dd0df20d14 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:32.286246 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-097bc1f0-c5de-44f6-b0c4-6fbaee360165 req-a257de94-31dc-4633-9a27-16dd0df20d14 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:32.297861 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-097bc1f0-c5de-44f6-b0c4-6fbaee360165 req-a257de94-31dc-4633-9a27-16dd0df20d14 service nova] Creating event network-vif-deleted:9011f65d-73a4-4471-925a-06f657690c61 for instance b9463099-568c-4c60-a669-3cd59a85b759 on hv-cinder-82301 Dec 27 14:24:32.302979 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-097bc1f0-c5de-44f6-b0c4-6fbaee360165 req-a257de94-31dc-4633-9a27-16dd0df20d14 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029973 Dec 27 14:24:32.303907 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 335/633] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:24:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:24:32.968982 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7a3f9405-3565-4fff-ac8d-328c57604648 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:32.969677 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7a3f9405-3565-4fff-ac8d-328c57604648 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:32.976528 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a3f9405-3565-4fff-ac8d-328c57604648 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:32.976978 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a3f9405-3565-4fff-ac8d-328c57604648 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:32.977765 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a3f9405-3565-4fff-ac8d-328c57604648 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:32.978203 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a3f9405-3565-4fff-ac8d-328c57604648 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:33.009324 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a3f9405-3565-4fff-ac8d-328c57604648 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:33.009776 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a3f9405-3565-4fff-ac8d-328c57604648 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:33.010382 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-7a3f9405-3565-4fff-ac8d-328c57604648 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lazy-loading 'fault' on Instance uuid b9463099-568c-4c60-a669-3cd59a85b759 {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:24:33.050618 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7a3f9405-3565-4fff-ac8d-328c57604648 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:33.058070 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7a3f9405-3565-4fff-ac8d-328c57604648 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759" status: 200 len: 1307 microversion: 2.1 time: 0.093125 Dec 27 14:24:33.058636 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 299/634] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:32 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759 => generated 1307 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:33.235209 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0971179d-af3b-4e9e-96c3-aa988632865a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:33.235883 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0971179d-af3b-4e9e-96c3-aa988632865a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:33.242072 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0971179d-af3b-4e9e-96c3-aa988632865a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:33.242526 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0971179d-af3b-4e9e-96c3-aa988632865a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:33.243312 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0971179d-af3b-4e9e-96c3-aa988632865a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:33.243750 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0971179d-af3b-4e9e-96c3-aa988632865a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:33.270368 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9df02489-0a66-4282-9304-e10d76fa7a19 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:33.271281 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9df02489-0a66-4282-9304-e10d76fa7a19 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:33.278159 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9df02489-0a66-4282-9304-e10d76fa7a19 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:33.278607 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9df02489-0a66-4282-9304-e10d76fa7a19 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:33.279414 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9df02489-0a66-4282-9304-e10d76fa7a19 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:33.279853 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9df02489-0a66-4282-9304-e10d76fa7a19 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:33.357708 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9df02489-0a66-4282-9304-e10d76fa7a19 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.090790 Dec 27 14:24:33.359205 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 300/635] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:33 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:24:33.383138 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0971179d-af3b-4e9e-96c3-aa988632865a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:33.393153 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0971179d-af3b-4e9e-96c3-aa988632865a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.162515 Dec 27 14:24:33.393895 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 336/636] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:33 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:33.469585 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f5453b40-1d8f-471b-a691-6d355f6fcd71 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:33.470162 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f5453b40-1d8f-471b-a691-6d355f6fcd71 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:33.477139 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5453b40-1d8f-471b-a691-6d355f6fcd71 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:33.477586 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5453b40-1d8f-471b-a691-6d355f6fcd71 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:33.478396 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5453b40-1d8f-471b-a691-6d355f6fcd71 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:33.478857 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f5453b40-1d8f-471b-a691-6d355f6fcd71 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:33.566786 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-f5453b40-1d8f-471b-a691-6d355f6fcd71 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lazy-loading 'services' on Instance uuid 77e5bc07-27af-405b-8aa6-c46ab71c6308 {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:24:33.636668 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f5453b40-1d8f-471b-a691-6d355f6fcd71 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "DELETE /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308/os-volume_attachments/9da66eb4-e820-4311-b48d-86da94e1fd7f" status: 202 len: 0 microversion: 2.1 time: 0.170703 Dec 27 14:24:33.637401 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 301/637] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Dec 27 14:24:33 2021] DELETE /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308/os-volume_attachments/9da66eb4-e820-4311-b48d-86da94e1fd7f => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:34.074911 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a3c3d1c4-ef75-4db4-84b1-e883e497b499 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:34.075521 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a3c3d1c4-ef75-4db4-84b1-e883e497b499 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: b9463099-568c-4c60-a669-3cd59a85b759] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:34.081831 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a3c3d1c4-ef75-4db4-84b1-e883e497b499 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:34.082283 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a3c3d1c4-ef75-4db4-84b1-e883e497b499 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:34.083056 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a3c3d1c4-ef75-4db4-84b1-e883e497b499 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:34.083488 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a3c3d1c4-ef75-4db4-84b1-e883e497b499 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:34.096457 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-a3c3d1c4-ef75-4db4-84b1-e883e497b499 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] HTTP exception thrown: Instance b9463099-568c-4c60-a669-3cd59a85b759 could not be found. Dec 27 14:24:34.097035 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a3c3d1c4-ef75-4db4-84b1-e883e497b499 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Returning 404 to user: Instance b9463099-568c-4c60-a669-3cd59a85b759 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:24:34.097838 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a3c3d1c4-ef75-4db4-84b1-e883e497b499 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759" status: 404 len: 111 microversion: 2.1 time: 0.026715 Dec 27 14:24:34.098357 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 337/638] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:34 2021] GET /compute/v2.1/servers/b9463099-568c-4c60-a669-3cd59a85b759 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:24:34.370234 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-22e438d4-31c3-4115-b541-81114d1f250c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:34.371227 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-22e438d4-31c3-4115-b541-81114d1f250c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:34.377754 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-22e438d4-31c3-4115-b541-81114d1f250c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:34.378220 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-22e438d4-31c3-4115-b541-81114d1f250c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:34.378991 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-22e438d4-31c3-4115-b541-81114d1f250c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:34.379419 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-22e438d4-31c3-4115-b541-81114d1f250c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:34.410434 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c3ede561-6a9a-4384-b4f1-e4feaf7f24f8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:34.411027 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c3ede561-6a9a-4384-b4f1-e4feaf7f24f8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:34.417471 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c3ede561-6a9a-4384-b4f1-e4feaf7f24f8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:34.417925 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c3ede561-6a9a-4384-b4f1-e4feaf7f24f8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:34.418700 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c3ede561-6a9a-4384-b4f1-e4feaf7f24f8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:34.419134 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c3ede561-6a9a-4384-b4f1-e4feaf7f24f8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:34.465815 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-22e438d4-31c3-4115-b541-81114d1f250c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.099720 Dec 27 14:24:34.466488 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 302/639] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:34 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:34.548831 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c3ede561-6a9a-4384-b4f1-e4feaf7f24f8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:34.556735 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c3ede561-6a9a-4384-b4f1-e4feaf7f24f8 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1567 microversion: 2.1 time: 0.149919 Dec 27 14:24:34.557471 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 338/640] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:34 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:35.223494 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3aa44b91-9545-4ff9-8e59-bcf8d5ccad74 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:35.224196 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3aa44b91-9545-4ff9-8e59-bcf8d5ccad74 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:35.231634 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3aa44b91-9545-4ff9-8e59-bcf8d5ccad74 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:35.232124 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3aa44b91-9545-4ff9-8e59-bcf8d5ccad74 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:35.232936 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3aa44b91-9545-4ff9-8e59-bcf8d5ccad74 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:35.233422 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3aa44b91-9545-4ff9-8e59-bcf8d5ccad74 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:35.258113 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3aa44b91-9545-4ff9-8e59-bcf8d5ccad74 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 27 14:24:35.330922 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3aa44b91-9545-4ff9-8e59-bcf8d5ccad74 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "DELETE /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49" status: 204 len: 0 microversion: 2.1 time: 0.111050 Dec 27 14:24:35.331667 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 303/641] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Dec 27 14:24:35 2021] DELETE /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 27 14:24:35.341196 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7343fddd-33d0-4c2e-9240-959b8400aef4 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:35.346673 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7343fddd-33d0-4c2e-9240-959b8400aef4 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:35.353042 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7343fddd-33d0-4c2e-9240-959b8400aef4 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:35.353498 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7343fddd-33d0-4c2e-9240-959b8400aef4 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:35.354336 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7343fddd-33d0-4c2e-9240-959b8400aef4 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:35.354806 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7343fddd-33d0-4c2e-9240-959b8400aef4 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:35.478833 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-100df12b-7ce7-400d-8bea-9122fd45082b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:35.480173 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-100df12b-7ce7-400d-8bea-9122fd45082b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:35.488169 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-100df12b-7ce7-400d-8bea-9122fd45082b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:35.488328 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-7343fddd-33d0-4c2e-9240-959b8400aef4 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:35.488756 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-100df12b-7ce7-400d-8bea-9122fd45082b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:35.490489 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-100df12b-7ce7-400d-8bea-9122fd45082b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:35.490946 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-100df12b-7ce7-400d-8bea-9122fd45082b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:35.496152 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7343fddd-33d0-4c2e-9240-959b8400aef4 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49" status: 200 len: 1514 microversion: 2.1 time: 0.160057 Dec 27 14:24:35.497137 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 339/642] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:35 2021] GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:35.573982 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ec2127c4-6515-459a-955c-dfb79bfe1cee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:35.574583 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ec2127c4-6515-459a-955c-dfb79bfe1cee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:35.580606 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ec2127c4-6515-459a-955c-dfb79bfe1cee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:35.581068 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ec2127c4-6515-459a-955c-dfb79bfe1cee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:35.581869 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ec2127c4-6515-459a-955c-dfb79bfe1cee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:35.582298 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ec2127c4-6515-459a-955c-dfb79bfe1cee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:35.585623 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-100df12b-7ce7-400d-8bea-9122fd45082b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.110940 Dec 27 14:24:35.590607 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 304/643] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:35 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:24:35.712353 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ec2127c4-6515-459a-955c-dfb79bfe1cee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:35.720050 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ec2127c4-6515-459a-955c-dfb79bfe1cee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1547 microversion: 2.1 time: 0.150259 Dec 27 14:24:35.720614 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 340/644] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:35 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:35.736670 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1d3ebeb9-0997-42bc-9f6b-29ab9875c4c2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:35.737256 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1d3ebeb9-0997-42bc-9f6b-29ab9875c4c2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:35.744045 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d3ebeb9-0997-42bc-9f6b-29ab9875c4c2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:35.745114 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d3ebeb9-0997-42bc-9f6b-29ab9875c4c2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:35.745903 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d3ebeb9-0997-42bc-9f6b-29ab9875c4c2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:35.746341 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d3ebeb9-0997-42bc-9f6b-29ab9875c4c2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:35.825282 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-1d3ebeb9-0997-42bc-9f6b-29ab9875c4c2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] HTTP exception thrown: Cannot 'detach_volume' instance 8520422d-f3a9-443c-9e9a-12fb03ef1bcc while it is in vm_state rescued Dec 27 14:24:35.825888 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1d3ebeb9-0997-42bc-9f6b-29ab9875c4c2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Returning 409 to user: Cannot 'detach_volume' instance 8520422d-f3a9-443c-9e9a-12fb03ef1bcc while it is in vm_state rescued {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:24:35.826725 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1d3ebeb9-0997-42bc-9f6b-29ab9875c4c2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "DELETE /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc/os-volume_attachments/acf226b1-5b42-4677-bbe8-cacf6eef4cfc" status: 409 len: 152 microversion: 2.1 time: 0.094173 Dec 27 14:24:35.827271 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 305/645] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Dec 27 14:24:35 2021] DELETE /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc/os-volume_attachments/acf226b1-5b42-4677-bbe8-cacf6eef4cfc => generated 152 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 27 14:24:35.835477 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-24682677-6f49-4e66-94ec-1f4e9f01a118 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:35.836150 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-24682677-6f49-4e66-94ec-1f4e9f01a118 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:35.842567 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24682677-6f49-4e66-94ec-1f4e9f01a118 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:35.843104 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24682677-6f49-4e66-94ec-1f4e9f01a118 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:35.844010 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24682677-6f49-4e66-94ec-1f4e9f01a118 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:35.844518 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24682677-6f49-4e66-94ec-1f4e9f01a118 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:35.907306 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-24682677-6f49-4e66-94ec-1f4e9f01a118 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "POST /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc/action" status: 202 len: 0 microversion: 2.1 time: 0.075267 Dec 27 14:24:35.908611 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 341/646] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:24:35 2021] POST /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:35.915810 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-615e616b-af02-424e-b2af-f3e10bec4323 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:35.917156 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-615e616b-af02-424e-b2af-f3e10bec4323 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:35.924110 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-615e616b-af02-424e-b2af-f3e10bec4323 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:35.924569 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-615e616b-af02-424e-b2af-f3e10bec4323 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:35.925355 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-615e616b-af02-424e-b2af-f3e10bec4323 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:35.925790 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-615e616b-af02-424e-b2af-f3e10bec4323 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:36.065951 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-615e616b-af02-424e-b2af-f3e10bec4323 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:36.076145 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-615e616b-af02-424e-b2af-f3e10bec4323 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1555 microversion: 2.1 time: 0.163868 Dec 27 14:24:36.076793 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 306/647] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:35 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:36.515170 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-14eb5af4-4af2-4640-915f-bb7515bc05dd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:36.515775 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-14eb5af4-4af2-4640-915f-bb7515bc05dd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:36.521902 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-14eb5af4-4af2-4640-915f-bb7515bc05dd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:36.522346 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-14eb5af4-4af2-4640-915f-bb7515bc05dd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:36.523173 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-14eb5af4-4af2-4640-915f-bb7515bc05dd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:36.523658 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-14eb5af4-4af2-4640-915f-bb7515bc05dd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:36.598311 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0534df39-90fe-4ee0-b2e5-bbdf537cf2e8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:36.599289 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0534df39-90fe-4ee0-b2e5-bbdf537cf2e8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:36.606730 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0534df39-90fe-4ee0-b2e5-bbdf537cf2e8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:36.607199 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0534df39-90fe-4ee0-b2e5-bbdf537cf2e8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:36.608026 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0534df39-90fe-4ee0-b2e5-bbdf537cf2e8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:36.608460 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0534df39-90fe-4ee0-b2e5-bbdf537cf2e8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:36.654766 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-14eb5af4-4af2-4640-915f-bb7515bc05dd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:36.662302 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-14eb5af4-4af2-4640-915f-bb7515bc05dd tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49" status: 200 len: 1514 microversion: 2.1 time: 0.152499 Dec 27 14:24:36.662870 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 342/648] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:36 2021] GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:36.695666 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0534df39-90fe-4ee0-b2e5-bbdf537cf2e8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.100853 Dec 27 14:24:36.698848 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 307/649] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:36 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:36.958805 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5ad7a381-cdea-45ba-9ca2-3b820fe0573d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:36.965223 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5ad7a381-cdea-45ba-9ca2-3b820fe0573d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:36.965891 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5ad7a381-cdea-45ba-9ca2-3b820fe0573d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:37.029717 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5ad7a381-cdea-45ba-9ca2-3b820fe0573d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Going to try to stop instance {{(pid=116105) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 27 14:24:37.070853 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5ad7a381-cdea-45ba-9ca2-3b820fe0573d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 202 len: 0 microversion: 2.1 time: 0.115501 Dec 27 14:24:37.071402 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 343/650] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:24:36 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:37.080438 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-45a2e0e7-a83c-47da-bf34-c37971309a79 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:37.081136 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-45a2e0e7-a83c-47da-bf34-c37971309a79 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:37.087980 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45a2e0e7-a83c-47da-bf34-c37971309a79 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:37.089059 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45a2e0e7-a83c-47da-bf34-c37971309a79 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:37.090005 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45a2e0e7-a83c-47da-bf34-c37971309a79 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:37.090653 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45a2e0e7-a83c-47da-bf34-c37971309a79 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:37.095404 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f9a669e3-2417-4c18-bca2-382f4d71b67e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:37.096142 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f9a669e3-2417-4c18-bca2-382f4d71b67e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:37.102193 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f9a669e3-2417-4c18-bca2-382f4d71b67e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:37.102640 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f9a669e3-2417-4c18-bca2-382f4d71b67e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:37.103417 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f9a669e3-2417-4c18-bca2-382f4d71b67e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:37.103933 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f9a669e3-2417-4c18-bca2-382f4d71b67e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:37.232073 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-45a2e0e7-a83c-47da-bf34-c37971309a79 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:37.239902 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-45a2e0e7-a83c-47da-bf34-c37971309a79 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1724 microversion: 2.1 time: 0.163454 Dec 27 14:24:37.240639 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 308/651] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:37 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:37.240858 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f9a669e3-2417-4c18-bca2-382f4d71b67e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:37.249337 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f9a669e3-2417-4c18-bca2-382f4d71b67e tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1555 microversion: 2.1 time: 0.157855 Dec 27 14:24:37.249895 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 344/652] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:37 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:37.678725 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9bc93807-b710-4f9d-8a9a-a236f4386555 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:37.679438 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9bc93807-b710-4f9d-8a9a-a236f4386555 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:37.686291 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9bc93807-b710-4f9d-8a9a-a236f4386555 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:37.686738 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9bc93807-b710-4f9d-8a9a-a236f4386555 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:37.687520 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9bc93807-b710-4f9d-8a9a-a236f4386555 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:37.688805 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9bc93807-b710-4f9d-8a9a-a236f4386555 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:37.707869 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1dee4445-69ec-4f2c-88be-7043d8db2470 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:37.708796 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1dee4445-69ec-4f2c-88be-7043d8db2470 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:37.715828 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1dee4445-69ec-4f2c-88be-7043d8db2470 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:37.716299 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1dee4445-69ec-4f2c-88be-7043d8db2470 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:37.717079 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1dee4445-69ec-4f2c-88be-7043d8db2470 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:37.717513 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1dee4445-69ec-4f2c-88be-7043d8db2470 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:37.828757 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9bc93807-b710-4f9d-8a9a-a236f4386555 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:37.836158 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9bc93807-b710-4f9d-8a9a-a236f4386555 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49" status: 200 len: 1514 microversion: 2.1 time: 0.160943 Dec 27 14:24:37.836722 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 309/653] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:37 2021] GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:37.872241 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1dee4445-69ec-4f2c-88be-7043d8db2470 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.167775 Dec 27 14:24:37.872992 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 345/654] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:37 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:24:37.899993 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-44d2e48f-1a4b-40b6-8fc4-7573b9266fca tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:37.900506 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-44d2e48f-1a4b-40b6-8fc4-7573b9266fca tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:37.907106 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44d2e48f-1a4b-40b6-8fc4-7573b9266fca tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:37.907544 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44d2e48f-1a4b-40b6-8fc4-7573b9266fca tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:37.908362 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44d2e48f-1a4b-40b6-8fc4-7573b9266fca tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:37.908794 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-44d2e48f-1a4b-40b6-8fc4-7573b9266fca tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:37.933083 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-44d2e48f-1a4b-40b6-8fc4-7573b9266fca tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 27 14:24:38.008747 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-44d2e48f-1a4b-40b6-8fc4-7573b9266fca tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "DELETE /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308" status: 204 len: 0 microversion: 2.1 time: 0.112030 Dec 27 14:24:38.009342 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 310/655] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Dec 27 14:24:37 2021] DELETE /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 27 14:24:38.020635 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b8a4f98d-6f43-42c8-b6d8-7b2112238c58 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:38.021902 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b8a4f98d-6f43-42c8-b6d8-7b2112238c58 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:38.029340 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b8a4f98d-6f43-42c8-b6d8-7b2112238c58 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:38.029790 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b8a4f98d-6f43-42c8-b6d8-7b2112238c58 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:38.030573 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b8a4f98d-6f43-42c8-b6d8-7b2112238c58 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:38.031273 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b8a4f98d-6f43-42c8-b6d8-7b2112238c58 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:38.257554 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fc82b56f-0655-42c3-b7f1-73c5f2416325 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:38.258281 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fc82b56f-0655-42c3-b7f1-73c5f2416325 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:38.262304 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b8a4f98d-6f43-42c8-b6d8-7b2112238c58 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:38.265226 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc82b56f-0655-42c3-b7f1-73c5f2416325 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:38.265679 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc82b56f-0655-42c3-b7f1-73c5f2416325 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:38.266469 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc82b56f-0655-42c3-b7f1-73c5f2416325 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:38.266898 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc82b56f-0655-42c3-b7f1-73c5f2416325 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:38.270374 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b8a4f98d-6f43-42c8-b6d8-7b2112238c58 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308" status: 200 len: 1514 microversion: 2.1 time: 0.255901 Dec 27 14:24:38.271924 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 346/656] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:38 2021] GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308 => generated 1514 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:38.276126 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b5ba6ea8-f5e9-495f-8c62-4fdb0f517e38 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:38.276733 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b5ba6ea8-f5e9-495f-8c62-4fdb0f517e38 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:38.282798 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b5ba6ea8-f5e9-495f-8c62-4fdb0f517e38 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:38.283419 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b5ba6ea8-f5e9-495f-8c62-4fdb0f517e38 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:38.284236 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b5ba6ea8-f5e9-495f-8c62-4fdb0f517e38 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:38.284699 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b5ba6ea8-f5e9-495f-8c62-4fdb0f517e38 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:38.409970 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fc82b56f-0655-42c3-b7f1-73c5f2416325 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:38.420321 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fc82b56f-0655-42c3-b7f1-73c5f2416325 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1724 microversion: 2.1 time: 0.166712 Dec 27 14:24:38.420911 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 311/657] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:38 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:38.505083 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b5ba6ea8-f5e9-495f-8c62-4fdb0f517e38 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:38.513499 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b5ba6ea8-f5e9-495f-8c62-4fdb0f517e38 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1555 microversion: 2.1 time: 0.241572 Dec 27 14:24:38.514079 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 347/658] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:38 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1555 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:38.532195 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-b1665994-c53d-48a6-a65e-fee8d466cce2 req-6901eeb3-f653-43af-bbbf-2c480e327bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0599d7cc-289a-4244-b9ad-0a46071fbd49", "name": "network-vif-deleted", "tag": "de0c9b82-59fd-43d3-bf0a-a38ca864e6de"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:38.533826 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:24:38.533826 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:24:38.542834 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-b1665994-c53d-48a6-a65e-fee8d466cce2 req-6901eeb3-f653-43af-bbbf-2c480e327bc5 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:38.543289 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-b1665994-c53d-48a6-a65e-fee8d466cce2 req-6901eeb3-f653-43af-bbbf-2c480e327bc5 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:38.555143 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-b1665994-c53d-48a6-a65e-fee8d466cce2 req-6901eeb3-f653-43af-bbbf-2c480e327bc5 service nova] Creating event network-vif-deleted:de0c9b82-59fd-43d3-bf0a-a38ca864e6de for instance 0599d7cc-289a-4244-b9ad-0a46071fbd49 on hv-cinder-82301 Dec 27 14:24:38.560546 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-b1665994-c53d-48a6-a65e-fee8d466cce2 req-6901eeb3-f653-43af-bbbf-2c480e327bc5 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032171 Dec 27 14:24:38.561152 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 312/659] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:24:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:24:38.853585 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fb6137cd-3782-43e4-8967-9dc1733dd006 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:38.854344 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fb6137cd-3782-43e4-8967-9dc1733dd006 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:38.860891 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fb6137cd-3782-43e4-8967-9dc1733dd006 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:38.861338 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fb6137cd-3782-43e4-8967-9dc1733dd006 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:38.862121 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fb6137cd-3782-43e4-8967-9dc1733dd006 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:38.862551 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fb6137cd-3782-43e4-8967-9dc1733dd006 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:38.884727 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7b926611-ce90-49fe-9626-0cd67468a647 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:38.886573 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7b926611-ce90-49fe-9626-0cd67468a647 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:38.893105 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b926611-ce90-49fe-9626-0cd67468a647 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:38.893585 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b926611-ce90-49fe-9626-0cd67468a647 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:38.894075 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fb6137cd-3782-43e4-8967-9dc1733dd006 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:38.894421 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b926611-ce90-49fe-9626-0cd67468a647 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:38.894538 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fb6137cd-3782-43e4-8967-9dc1733dd006 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:38.894857 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b926611-ce90-49fe-9626-0cd67468a647 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:38.894969 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.objects.instance [None req-fb6137cd-3782-43e4-8967-9dc1733dd006 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lazy-loading 'fault' on Instance uuid 0599d7cc-289a-4244-b9ad-0a46071fbd49 {{(pid=116105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:24:38.933696 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-fb6137cd-3782-43e4-8967-9dc1733dd006 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:38.941053 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fb6137cd-3782-43e4-8967-9dc1733dd006 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49" status: 200 len: 1308 microversion: 2.1 time: 0.091213 Dec 27 14:24:38.941614 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 348/660] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:38 2021] GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49 => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:38.976154 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7b926611-ce90-49fe-9626-0cd67468a647 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.095631 Dec 27 14:24:38.976897 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 313/661] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:38 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:24:39.287252 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-bbbb2ef8-61ac-44e5-a48d-2877f63bb0d3 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:39.287936 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-bbbb2ef8-61ac-44e5-a48d-2877f63bb0d3 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:39.293951 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bbbb2ef8-61ac-44e5-a48d-2877f63bb0d3 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:39.294397 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bbbb2ef8-61ac-44e5-a48d-2877f63bb0d3 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:39.295166 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bbbb2ef8-61ac-44e5-a48d-2877f63bb0d3 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:39.295597 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bbbb2ef8-61ac-44e5-a48d-2877f63bb0d3 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:39.427711 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-bbbb2ef8-61ac-44e5-a48d-2877f63bb0d3 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:39.435469 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-bbbb2ef8-61ac-44e5-a48d-2877f63bb0d3 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308" status: 200 len: 1514 microversion: 2.1 time: 0.151794 Dec 27 14:24:39.436065 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 349/662] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:39 2021] GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:39.438858 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9db314b1-5194-45a1-8c42-3738ee046c3f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:39.439659 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9db314b1-5194-45a1-8c42-3738ee046c3f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:39.446464 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9db314b1-5194-45a1-8c42-3738ee046c3f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:39.446985 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9db314b1-5194-45a1-8c42-3738ee046c3f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:39.448406 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9db314b1-5194-45a1-8c42-3738ee046c3f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:39.448840 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9db314b1-5194-45a1-8c42-3738ee046c3f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:39.532249 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3d961687-e481-4348-a932-fca6e22d3631 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:39.533219 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3d961687-e481-4348-a932-fca6e22d3631 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:39.539572 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3d961687-e481-4348-a932-fca6e22d3631 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:39.540268 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3d961687-e481-4348-a932-fca6e22d3631 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:39.541087 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3d961687-e481-4348-a932-fca6e22d3631 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:39.542218 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3d961687-e481-4348-a932-fca6e22d3631 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:39.583387 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9db314b1-5194-45a1-8c42-3738ee046c3f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:39.592140 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9db314b1-5194-45a1-8c42-3738ee046c3f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1724 microversion: 2.1 time: 0.157460 Dec 27 14:24:39.592712 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 314/663] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:39 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:39.674438 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3d961687-e481-4348-a932-fca6e22d3631 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:39.682468 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3d961687-e481-4348-a932-fca6e22d3631 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1555 microversion: 2.1 time: 0.154563 Dec 27 14:24:39.682978 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 350/664] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:39 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:39.957720 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-766dc003-7c89-4e48-a904-7e9f9c5b1170 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:39.958329 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-766dc003-7c89-4e48-a904-7e9f9c5b1170 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 0599d7cc-289a-4244-b9ad-0a46071fbd49] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:39.965350 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-766dc003-7c89-4e48-a904-7e9f9c5b1170 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:39.965822 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-766dc003-7c89-4e48-a904-7e9f9c5b1170 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:39.966604 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-766dc003-7c89-4e48-a904-7e9f9c5b1170 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:39.967035 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-766dc003-7c89-4e48-a904-7e9f9c5b1170 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:39.981537 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-766dc003-7c89-4e48-a904-7e9f9c5b1170 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] HTTP exception thrown: Instance 0599d7cc-289a-4244-b9ad-0a46071fbd49 could not be found. Dec 27 14:24:39.982113 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-766dc003-7c89-4e48-a904-7e9f9c5b1170 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Returning 404 to user: Instance 0599d7cc-289a-4244-b9ad-0a46071fbd49 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:24:39.983008 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-766dc003-7c89-4e48-a904-7e9f9c5b1170 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49" status: 404 len: 111 microversion: 2.1 time: 0.029011 Dec 27 14:24:39.983530 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 315/665] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:39 2021] GET /compute/v2.1/servers/0599d7cc-289a-4244-b9ad-0a46071fbd49 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:24:39.987472 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-263ad5ac-e661-4c78-a5cb-245e12111f68 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:39.988517 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-263ad5ac-e661-4c78-a5cb-245e12111f68 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:39.991050 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0e95aaeb-4e54-43bc-b29f-d101b3673df4 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:39.991555 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0e95aaeb-4e54-43bc-b29f-d101b3673df4 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:39.994413 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-263ad5ac-e661-4c78-a5cb-245e12111f68 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:39.994867 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-263ad5ac-e661-4c78-a5cb-245e12111f68 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:39.995803 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-263ad5ac-e661-4c78-a5cb-245e12111f68 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:39.996271 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-263ad5ac-e661-4c78-a5cb-245e12111f68 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:39.997519 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e95aaeb-4e54-43bc-b29f-d101b3673df4 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:39.997960 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e95aaeb-4e54-43bc-b29f-d101b3673df4 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:39.998728 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e95aaeb-4e54-43bc-b29f-d101b3673df4 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:39.999158 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e95aaeb-4e54-43bc-b29f-d101b3673df4 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:40.024448 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0e95aaeb-4e54-43bc-b29f-d101b3673df4 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 27 14:24:40.097051 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0e95aaeb-4e54-43bc-b29f-d101b3673df4 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "DELETE /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 204 len: 0 microversion: 2.1 time: 0.109270 Dec 27 14:24:40.097625 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 316/666] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Dec 27 14:24:39 2021] DELETE /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 27 14:24:40.107089 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-34c75a7e-d509-4f93-96e2-289386f175f3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:40.107907 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-34c75a7e-d509-4f93-96e2-289386f175f3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:40.112948 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-263ad5ac-e661-4c78-a5cb-245e12111f68 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28229 microversion: 2.20 time: 0.128978 Dec 27 14:24:40.113626 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 351/667] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:39 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28229 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:24:40.114414 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34c75a7e-d509-4f93-96e2-289386f175f3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:40.114859 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34c75a7e-d509-4f93-96e2-289386f175f3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:40.115637 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34c75a7e-d509-4f93-96e2-289386f175f3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:40.116092 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34c75a7e-d509-4f93-96e2-289386f175f3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:40.248133 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-34c75a7e-d509-4f93-96e2-289386f175f3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:40.255374 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-34c75a7e-d509-4f93-96e2-289386f175f3 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1515 microversion: 2.1 time: 0.153515 Dec 27 14:24:40.255952 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 317/668] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:40 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:40.453457 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-dcd8dbbf-5570-4954-8ae7-893dc1e64786 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:40.454150 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-dcd8dbbf-5570-4954-8ae7-893dc1e64786 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:40.461036 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dcd8dbbf-5570-4954-8ae7-893dc1e64786 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:40.461483 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dcd8dbbf-5570-4954-8ae7-893dc1e64786 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:40.462260 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dcd8dbbf-5570-4954-8ae7-893dc1e64786 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:40.462703 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dcd8dbbf-5570-4954-8ae7-893dc1e64786 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:40.609295 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c43fdb2e-2b20-408e-a183-8900efed9c85 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:40.609909 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c43fdb2e-2b20-408e-a183-8900efed9c85 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:40.615937 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c43fdb2e-2b20-408e-a183-8900efed9c85 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:40.616397 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c43fdb2e-2b20-408e-a183-8900efed9c85 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:40.617191 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c43fdb2e-2b20-408e-a183-8900efed9c85 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:40.617631 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c43fdb2e-2b20-408e-a183-8900efed9c85 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:40.642664 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-dcd8dbbf-5570-4954-8ae7-893dc1e64786 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:40.650198 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-dcd8dbbf-5570-4954-8ae7-893dc1e64786 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308" status: 200 len: 1514 microversion: 2.1 time: 0.200756 Dec 27 14:24:40.660303 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 352/669] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:40 2021] GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308 => generated 1514 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:40.699109 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8f3a9d54-2dca-452f-9475-0aa70155db4c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:40.699729 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8f3a9d54-2dca-452f-9475-0aa70155db4c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:40.705974 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f3a9d54-2dca-452f-9475-0aa70155db4c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:40.706429 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f3a9d54-2dca-452f-9475-0aa70155db4c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:40.707222 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f3a9d54-2dca-452f-9475-0aa70155db4c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:40.707943 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8f3a9d54-2dca-452f-9475-0aa70155db4c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:40.753769 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c43fdb2e-2b20-408e-a183-8900efed9c85 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:40.762318 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c43fdb2e-2b20-408e-a183-8900efed9c85 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1724 microversion: 2.1 time: 0.156610 Dec 27 14:24:40.763115 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 318/670] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:40 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:40.915428 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8f3a9d54-2dca-452f-9475-0aa70155db4c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:40.923417 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8f3a9d54-2dca-452f-9475-0aa70155db4c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1561 microversion: 2.1 time: 0.228674 Dec 27 14:24:40.924080 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 353/671] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:40 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1561 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:40.989559 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-780c266c-2aab-4b89-8c79-8981127b10a6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:40.990073 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-780c266c-2aab-4b89-8c79-8981127b10a6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:40.996651 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-780c266c-2aab-4b89-8c79-8981127b10a6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:40.997096 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-780c266c-2aab-4b89-8c79-8981127b10a6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:40.997873 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-780c266c-2aab-4b89-8c79-8981127b10a6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:40.998300 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-780c266c-2aab-4b89-8c79-8981127b10a6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:41.079445 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-780c266c-2aab-4b89-8c79-8981127b10a6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lazy-loading 'services' on Instance uuid 8520422d-f3a9-443c-9e9a-12fb03ef1bcc {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:24:41.125709 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4d8e59c4-ca35-4904-9426-a80c6c6ffabc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:41.127164 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4d8e59c4-ca35-4904-9426-a80c6c6ffabc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:41.133976 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4d8e59c4-ca35-4904-9426-a80c6c6ffabc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:41.134418 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4d8e59c4-ca35-4904-9426-a80c6c6ffabc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:41.135322 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4d8e59c4-ca35-4904-9426-a80c6c6ffabc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:41.135706 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4d8e59c4-ca35-4904-9426-a80c6c6ffabc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:41.166826 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-780c266c-2aab-4b89-8c79-8981127b10a6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "DELETE /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc/os-volume_attachments/acf226b1-5b42-4677-bbe8-cacf6eef4cfc" status: 202 len: 0 microversion: 2.1 time: 0.180868 Dec 27 14:24:41.167403 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 319/672] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Dec 27 14:24:40 2021] DELETE /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc/os-volume_attachments/acf226b1-5b42-4677-bbe8-cacf6eef4cfc => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:41.172601 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-16e9560e-7f26-416a-a95a-4c04db92adec req-aa04bd0e-66c7-4742-b8ff-7bf6bc4cdfa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77e5bc07-27af-405b-8aa6-c46ab71c6308", "name": "network-vif-deleted", "tag": "b0dc9db5-833a-4012-9679-5e5a903f1834"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:41.174121 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:24:41.174121 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:24:41.181182 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-16e9560e-7f26-416a-a95a-4c04db92adec req-aa04bd0e-66c7-4742-b8ff-7bf6bc4cdfa1 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:41.182502 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-16e9560e-7f26-416a-a95a-4c04db92adec req-aa04bd0e-66c7-4742-b8ff-7bf6bc4cdfa1 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:41.193659 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-16e9560e-7f26-416a-a95a-4c04db92adec req-aa04bd0e-66c7-4742-b8ff-7bf6bc4cdfa1 service nova] Creating event network-vif-deleted:b0dc9db5-833a-4012-9679-5e5a903f1834 for instance 77e5bc07-27af-405b-8aa6-c46ab71c6308 on hv-cinder-82301 Dec 27 14:24:41.199319 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-16e9560e-7f26-416a-a95a-4c04db92adec req-aa04bd0e-66c7-4742-b8ff-7bf6bc4cdfa1 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030631 Dec 27 14:24:41.199945 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 320/673] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:24:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:24:41.204974 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cbd60af4-caa6-4cfc-80ea-f20bed4da7df tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:41.206005 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cbd60af4-caa6-4cfc-80ea-f20bed4da7df tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:41.212127 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cbd60af4-caa6-4cfc-80ea-f20bed4da7df tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:41.212576 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cbd60af4-caa6-4cfc-80ea-f20bed4da7df tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:41.213687 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cbd60af4-caa6-4cfc-80ea-f20bed4da7df tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:41.214123 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cbd60af4-caa6-4cfc-80ea-f20bed4da7df tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:41.243298 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cbd60af4-caa6-4cfc-80ea-f20bed4da7df tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041991 Dec 27 14:24:41.243855 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 321/674] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:24:41 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:24:41.258593 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4d8e59c4-ca35-4904-9426-a80c6c6ffabc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28244 microversion: 2.20 time: 0.136619 Dec 27 14:24:41.259244 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 354/675] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:41 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28244 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:24:41.271541 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5a075db6-3b66-419f-a6dd-347410c3b1ea tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:41.272167 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5a075db6-3b66-419f-a6dd-347410c3b1ea tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:41.278384 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a075db6-3b66-419f-a6dd-347410c3b1ea tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:41.278905 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a075db6-3b66-419f-a6dd-347410c3b1ea tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:41.279708 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a075db6-3b66-419f-a6dd-347410c3b1ea tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:41.280257 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a075db6-3b66-419f-a6dd-347410c3b1ea tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:41.420455 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5a075db6-3b66-419f-a6dd-347410c3b1ea tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:41.427768 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5a075db6-3b66-419f-a6dd-347410c3b1ea tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1515 microversion: 2.1 time: 0.159660 Dec 27 14:24:41.428355 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 322/676] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:41 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:41.668218 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-88808120-ecfa-4959-b231-303f10774481 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:41.668819 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-88808120-ecfa-4959-b231-303f10774481 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:41.676117 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-88808120-ecfa-4959-b231-303f10774481 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:41.676562 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-88808120-ecfa-4959-b231-303f10774481 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:41.677329 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-88808120-ecfa-4959-b231-303f10774481 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:41.677761 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-88808120-ecfa-4959-b231-303f10774481 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:41.707432 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-88808120-ecfa-4959-b231-303f10774481 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:41.707905 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-88808120-ecfa-4959-b231-303f10774481 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:41.708344 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.objects.instance [None req-88808120-ecfa-4959-b231-303f10774481 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lazy-loading 'fault' on Instance uuid 77e5bc07-27af-405b-8aa6-c46ab71c6308 {{(pid=116105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:24:41.748631 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-88808120-ecfa-4959-b231-303f10774481 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:41.756573 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-88808120-ecfa-4959-b231-303f10774481 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308" status: 200 len: 1309 microversion: 2.1 time: 0.092575 Dec 27 14:24:41.757153 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 355/677] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:41 2021] GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308 => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:41.778570 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f0b413ac-bb8f-4285-8ba6-f7846083fe63 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:41.779171 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f0b413ac-bb8f-4285-8ba6-f7846083fe63 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:41.785774 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f0b413ac-bb8f-4285-8ba6-f7846083fe63 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:41.786220 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f0b413ac-bb8f-4285-8ba6-f7846083fe63 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:41.787001 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f0b413ac-bb8f-4285-8ba6-f7846083fe63 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:41.787468 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f0b413ac-bb8f-4285-8ba6-f7846083fe63 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:41.922602 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f0b413ac-bb8f-4285-8ba6-f7846083fe63 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:41.933814 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f0b413ac-bb8f-4285-8ba6-f7846083fe63 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1724 microversion: 2.1 time: 0.159267 Dec 27 14:24:41.934407 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 323/678] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:41 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:42.255136 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ca4c2444-87fa-476c-8662-e107b05667d2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:42.256223 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ca4c2444-87fa-476c-8662-e107b05667d2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:42.262419 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ca4c2444-87fa-476c-8662-e107b05667d2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:42.262873 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ca4c2444-87fa-476c-8662-e107b05667d2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:42.263676 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ca4c2444-87fa-476c-8662-e107b05667d2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:42.264141 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ca4c2444-87fa-476c-8662-e107b05667d2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:42.270964 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c217937e-14f7-4995-80ca-b38331dd57a1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:42.271908 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c217937e-14f7-4995-80ca-b38331dd57a1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:42.279182 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c217937e-14f7-4995-80ca-b38331dd57a1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:42.279637 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c217937e-14f7-4995-80ca-b38331dd57a1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:42.280453 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c217937e-14f7-4995-80ca-b38331dd57a1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:42.281351 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c217937e-14f7-4995-80ca-b38331dd57a1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:42.295499 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ca4c2444-87fa-476c-8662-e107b05667d2 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044754 Dec 27 14:24:42.296435 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 356/679] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:24:42 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:24:42.394719 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c217937e-14f7-4995-80ca-b38331dd57a1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28520 microversion: 2.20 time: 0.127372 Dec 27 14:24:42.395372 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 324/680] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:42 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28520 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:42.444064 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2365504f-6620-42df-a033-1fe93883b249 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:42.444683 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2365504f-6620-42df-a033-1fe93883b249 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:42.451263 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2365504f-6620-42df-a033-1fe93883b249 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:42.451711 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2365504f-6620-42df-a033-1fe93883b249 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:42.452524 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2365504f-6620-42df-a033-1fe93883b249 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:42.452970 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2365504f-6620-42df-a033-1fe93883b249 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:42.580276 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-2365504f-6620-42df-a033-1fe93883b249 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:42.587423 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2365504f-6620-42df-a033-1fe93883b249 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1515 microversion: 2.1 time: 0.146992 Dec 27 14:24:42.588863 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 357/681] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:42 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:42.773913 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b7be96d0-42e1-4208-9680-8c308c618fce tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:42.774799 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b7be96d0-42e1-4208-9680-8c308c618fce tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: 77e5bc07-27af-405b-8aa6-c46ab71c6308] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:42.782723 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b7be96d0-42e1-4208-9680-8c308c618fce tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:42.783137 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b7be96d0-42e1-4208-9680-8c308c618fce tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:42.783965 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b7be96d0-42e1-4208-9680-8c308c618fce tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:42.784408 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b7be96d0-42e1-4208-9680-8c308c618fce tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:42.799115 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-b7be96d0-42e1-4208-9680-8c308c618fce tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] HTTP exception thrown: Instance 77e5bc07-27af-405b-8aa6-c46ab71c6308 could not be found. Dec 27 14:24:42.799729 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b7be96d0-42e1-4208-9680-8c308c618fce tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Returning 404 to user: Instance 77e5bc07-27af-405b-8aa6-c46ab71c6308 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:24:42.800594 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b7be96d0-42e1-4208-9680-8c308c618fce tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308" status: 404 len: 111 microversion: 2.1 time: 0.030806 Dec 27 14:24:42.801138 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 325/682] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:42 2021] GET /compute/v2.1/servers/77e5bc07-27af-405b-8aa6-c46ab71c6308 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:24:42.951405 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-07bd89db-8fca-4166-8e87-c39f0766bfba tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:42.952157 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-07bd89db-8fca-4166-8e87-c39f0766bfba tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:42.961511 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-07bd89db-8fca-4166-8e87-c39f0766bfba tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:42.961959 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-07bd89db-8fca-4166-8e87-c39f0766bfba tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:42.967148 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-07bd89db-8fca-4166-8e87-c39f0766bfba tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:42.967148 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-07bd89db-8fca-4166-8e87-c39f0766bfba tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:43.192914 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-07bd89db-8fca-4166-8e87-c39f0766bfba tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:43.201160 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-07bd89db-8fca-4166-8e87-c39f0766bfba tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1724 microversion: 2.1 time: 0.254444 Dec 27 14:24:43.201744 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 358/683] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:42 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:43.216641 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-f6f97d01-57b3-49f8-a5a3-6b7b0c57d7b5 req-6114aa08-4534-4f64-8c15-a979042e5962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd94dbb7-24cb-4eef-9d37-088c69b3fc45", "name": "network-vif-deleted", "tag": "f680b340-28a2-42f0-ac86-bdf63408f922"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:43.218437 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:24:43.218437 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:24:43.225500 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-f6f97d01-57b3-49f8-a5a3-6b7b0c57d7b5 req-6114aa08-4534-4f64-8c15-a979042e5962 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:43.226078 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-f6f97d01-57b3-49f8-a5a3-6b7b0c57d7b5 req-6114aa08-4534-4f64-8c15-a979042e5962 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:43.238469 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-f6f97d01-57b3-49f8-a5a3-6b7b0c57d7b5 req-6114aa08-4534-4f64-8c15-a979042e5962 service nova] Creating event network-vif-deleted:f680b340-28a2-42f0-ac86-bdf63408f922 for instance cd94dbb7-24cb-4eef-9d37-088c69b3fc45 on hv-cinder-82301 Dec 27 14:24:43.243322 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-f6f97d01-57b3-49f8-a5a3-6b7b0c57d7b5 req-6114aa08-4534-4f64-8c15-a979042e5962 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031780 Dec 27 14:24:43.244793 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 326/684] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:24:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:24:43.308252 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f7abd1b8-f78f-4e51-bc26-aefb2df85a2a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:43.309172 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f7abd1b8-f78f-4e51-bc26-aefb2df85a2a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:43.315202 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f7abd1b8-f78f-4e51-bc26-aefb2df85a2a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:43.315646 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f7abd1b8-f78f-4e51-bc26-aefb2df85a2a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:43.316455 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f7abd1b8-f78f-4e51-bc26-aefb2df85a2a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:43.316890 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f7abd1b8-f78f-4e51-bc26-aefb2df85a2a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:43.344980 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f7abd1b8-f78f-4e51-bc26-aefb2df85a2a tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042044 Dec 27 14:24:43.345530 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 359/685] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:24:43 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 27 14:24:43.407685 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cd89aba7-febf-4e33-9f9f-761a2bcbeee4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:43.408684 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cd89aba7-febf-4e33-9f9f-761a2bcbeee4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:43.415105 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd89aba7-febf-4e33-9f9f-761a2bcbeee4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:43.415558 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd89aba7-febf-4e33-9f9f-761a2bcbeee4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:43.416585 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd89aba7-febf-4e33-9f9f-761a2bcbeee4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:43.417034 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd89aba7-febf-4e33-9f9f-761a2bcbeee4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:43.604753 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-94e3b845-ae09-4d9f-85e9-f315804b0d90 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:43.605300 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-94e3b845-ae09-4d9f-85e9-f315804b0d90 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:43.611970 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-94e3b845-ae09-4d9f-85e9-f315804b0d90 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:43.613413 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-94e3b845-ae09-4d9f-85e9-f315804b0d90 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:43.614224 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-94e3b845-ae09-4d9f-85e9-f315804b0d90 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:43.615499 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-94e3b845-ae09-4d9f-85e9-f315804b0d90 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:43.647202 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-94e3b845-ae09-4d9f-85e9-f315804b0d90 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:43.647992 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-94e3b845-ae09-4d9f-85e9-f315804b0d90 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:43.648459 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.objects.instance [None req-94e3b845-ae09-4d9f-85e9-f315804b0d90 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lazy-loading 'fault' on Instance uuid cd94dbb7-24cb-4eef-9d37-088c69b3fc45 {{(pid=116105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:24:43.687824 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-94e3b845-ae09-4d9f-85e9-f315804b0d90 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:43.694963 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-94e3b845-ae09-4d9f-85e9-f315804b0d90 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1308 microversion: 2.1 time: 0.094703 Dec 27 14:24:43.695532 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 360/686] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:43 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:44.218871 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-41080aa0-0e0f-4469-ac92-f123ce38b003 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:44.219570 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-41080aa0-0e0f-4469-ac92-f123ce38b003 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:44.225877 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-41080aa0-0e0f-4469-ac92-f123ce38b003 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:44.226271 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-41080aa0-0e0f-4469-ac92-f123ce38b003 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:44.227047 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-41080aa0-0e0f-4469-ac92-f123ce38b003 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:44.227482 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-41080aa0-0e0f-4469-ac92-f123ce38b003 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:44.359101 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-41080aa0-0e0f-4469-ac92-f123ce38b003 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:44.366860 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-41080aa0-0e0f-4469-ac92-f123ce38b003 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1724 microversion: 2.1 time: 0.151594 Dec 27 14:24:44.367423 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 361/687] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:44 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:44.711104 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0fc36d0c-a091-4a44-9ac8-8e9e059ae226 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:44.711717 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0fc36d0c-a091-4a44-9ac8-8e9e059ae226 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:44.718301 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0fc36d0c-a091-4a44-9ac8-8e9e059ae226 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:44.718782 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0fc36d0c-a091-4a44-9ac8-8e9e059ae226 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:44.719565 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0fc36d0c-a091-4a44-9ac8-8e9e059ae226 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:44.720035 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0fc36d0c-a091-4a44-9ac8-8e9e059ae226 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:44.749416 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0fc36d0c-a091-4a44-9ac8-8e9e059ae226 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:44.749881 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0fc36d0c-a091-4a44-9ac8-8e9e059ae226 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:44.750324 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.objects.instance [None req-0fc36d0c-a091-4a44-9ac8-8e9e059ae226 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lazy-loading 'fault' on Instance uuid cd94dbb7-24cb-4eef-9d37-088c69b3fc45 {{(pid=116105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:24:44.788696 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0fc36d0c-a091-4a44-9ac8-8e9e059ae226 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:44.795864 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0fc36d0c-a091-4a44-9ac8-8e9e059ae226 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1308 microversion: 2.1 time: 0.088329 Dec 27 14:24:44.796427 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 362/688] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:44 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1308 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:45.382837 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-92102cf2-b077-42a2-8543-2831c7f37895 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:45.383470 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-92102cf2-b077-42a2-8543-2831c7f37895 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:45.389379 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-92102cf2-b077-42a2-8543-2831c7f37895 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:45.389819 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-92102cf2-b077-42a2-8543-2831c7f37895 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:45.390582 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-92102cf2-b077-42a2-8543-2831c7f37895 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:45.391015 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-92102cf2-b077-42a2-8543-2831c7f37895 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:45.519652 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-92102cf2-b077-42a2-8543-2831c7f37895 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:45.528390 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-92102cf2-b077-42a2-8543-2831c7f37895 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1724 microversion: 2.1 time: 0.148877 Dec 27 14:24:45.528611 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 363/689] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:45 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:45.749452 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cd89aba7-febf-4e33-9f9f-761a2bcbeee4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28520 microversion: 2.20 time: 2.346514 Dec 27 14:24:45.750445 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 327/690] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:43 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28520 bytes in 2348 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:45.812732 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6ebee785-6e80-46d9-8fb5-441e499572a0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:45.813339 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6ebee785-6e80-46d9-8fb5-441e499572a0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:45.819942 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6ebee785-6e80-46d9-8fb5-441e499572a0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:45.820391 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6ebee785-6e80-46d9-8fb5-441e499572a0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:45.821166 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6ebee785-6e80-46d9-8fb5-441e499572a0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:45.821599 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6ebee785-6e80-46d9-8fb5-441e499572a0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:45.851198 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6ebee785-6e80-46d9-8fb5-441e499572a0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:45.851678 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6ebee785-6e80-46d9-8fb5-441e499572a0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:45.852150 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.objects.instance [None req-6ebee785-6e80-46d9-8fb5-441e499572a0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lazy-loading 'fault' on Instance uuid cd94dbb7-24cb-4eef-9d37-088c69b3fc45 {{(pid=116105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:24:45.891003 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6ebee785-6e80-46d9-8fb5-441e499572a0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:45.898180 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6ebee785-6e80-46d9-8fb5-441e499572a0 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1308 microversion: 2.1 time: 0.089087 Dec 27 14:24:45.898727 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 364/691] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:45 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1308 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:46.546618 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6c97ff17-5f88-4e48-bd9b-f62851374c00 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:46.547310 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6c97ff17-5f88-4e48-bd9b-f62851374c00 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:46.555201 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c97ff17-5f88-4e48-bd9b-f62851374c00 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:46.555645 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c97ff17-5f88-4e48-bd9b-f62851374c00 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:46.556467 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c97ff17-5f88-4e48-bd9b-f62851374c00 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:46.556902 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c97ff17-5f88-4e48-bd9b-f62851374c00 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:46.689862 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6c97ff17-5f88-4e48-bd9b-f62851374c00 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:46.698114 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6c97ff17-5f88-4e48-bd9b-f62851374c00 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1724 microversion: 2.1 time: 0.156631 Dec 27 14:24:46.698867 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 328/692] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:46 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:46.761367 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-cc24f4e8-5247-4ccf-8c35-5c5ceabe1708 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:46.762286 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-cc24f4e8-5247-4ccf-8c35-5c5ceabe1708 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:46.768238 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc24f4e8-5247-4ccf-8c35-5c5ceabe1708 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:46.768689 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc24f4e8-5247-4ccf-8c35-5c5ceabe1708 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:46.769460 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc24f4e8-5247-4ccf-8c35-5c5ceabe1708 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:46.769893 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc24f4e8-5247-4ccf-8c35-5c5ceabe1708 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:46.913657 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bce89d59-beaf-4ce7-ac9b-1d39a1aa5747 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:46.914158 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bce89d59-beaf-4ce7-ac9b-1d39a1aa5747 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:46.920541 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bce89d59-beaf-4ce7-ac9b-1d39a1aa5747 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:46.920984 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bce89d59-beaf-4ce7-ac9b-1d39a1aa5747 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:46.921750 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bce89d59-beaf-4ce7-ac9b-1d39a1aa5747 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:46.922178 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bce89d59-beaf-4ce7-ac9b-1d39a1aa5747 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:46.955432 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bce89d59-beaf-4ce7-ac9b-1d39a1aa5747 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:46.955902 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bce89d59-beaf-4ce7-ac9b-1d39a1aa5747 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:46.956344 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-bce89d59-beaf-4ce7-ac9b-1d39a1aa5747 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lazy-loading 'fault' on Instance uuid cd94dbb7-24cb-4eef-9d37-088c69b3fc45 {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:24:46.994769 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bce89d59-beaf-4ce7-ac9b-1d39a1aa5747 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:47.001875 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bce89d59-beaf-4ce7-ac9b-1d39a1aa5747 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 200 len: 1308 microversion: 2.1 time: 0.091867 Dec 27 14:24:47.002433 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 329/693] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:46 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 1308 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:47.346784 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-cc24f4e8-5247-4ccf-8c35-5c5ceabe1708 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28625 microversion: 2.20 time: 0.589238 Dec 27 14:24:47.347549 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 365/694] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:46 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28625 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:47.715722 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0b7befee-2142-4451-af15-d4136ff0f669 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:47.716378 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0b7befee-2142-4451-af15-d4136ff0f669 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:47.722665 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0b7befee-2142-4451-af15-d4136ff0f669 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:47.723149 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0b7befee-2142-4451-af15-d4136ff0f669 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:47.723963 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0b7befee-2142-4451-af15-d4136ff0f669 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:47.724406 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0b7befee-2142-4451-af15-d4136ff0f669 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:47.853003 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0b7befee-2142-4451-af15-d4136ff0f669 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:47.861645 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0b7befee-2142-4451-af15-d4136ff0f669 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1724 microversion: 2.1 time: 0.150134 Dec 27 14:24:47.862206 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 330/695] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:47 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:48.018700 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-72a8058e-0edc-45ba-b150-da35dbb422aa tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:48.019397 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-72a8058e-0edc-45ba-b150-da35dbb422aa tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: cd94dbb7-24cb-4eef-9d37-088c69b3fc45] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:48.027002 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72a8058e-0edc-45ba-b150-da35dbb422aa tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:48.027446 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72a8058e-0edc-45ba-b150-da35dbb422aa tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:48.028287 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72a8058e-0edc-45ba-b150-da35dbb422aa tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:48.028714 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72a8058e-0edc-45ba-b150-da35dbb422aa tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:48.044654 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-72a8058e-0edc-45ba-b150-da35dbb422aa tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] HTTP exception thrown: Instance cd94dbb7-24cb-4eef-9d37-088c69b3fc45 could not be found. Dec 27 14:24:48.045237 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-72a8058e-0edc-45ba-b150-da35dbb422aa tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Returning 404 to user: Instance cd94dbb7-24cb-4eef-9d37-088c69b3fc45 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:24:48.046046 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-72a8058e-0edc-45ba-b150-da35dbb422aa tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45" status: 404 len: 111 microversion: 2.1 time: 0.031353 Dec 27 14:24:48.046579 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 366/696] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:48 2021] GET /compute/v2.1/servers/cd94dbb7-24cb-4eef-9d37-088c69b3fc45 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:24:48.358429 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3b04e8ca-6054-4869-ae2b-a7092f6d27da tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:48.359368 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3b04e8ca-6054-4869-ae2b-a7092f6d27da tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:48.365724 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b04e8ca-6054-4869-ae2b-a7092f6d27da tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:48.366183 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b04e8ca-6054-4869-ae2b-a7092f6d27da tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:48.366965 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b04e8ca-6054-4869-ae2b-a7092f6d27da tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:48.367400 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b04e8ca-6054-4869-ae2b-a7092f6d27da tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:48.441438 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3b04e8ca-6054-4869-ae2b-a7092f6d27da tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.086507 Dec 27 14:24:48.442058 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 331/697] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:48 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:48.878203 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-24eb6380-b440-45c0-acb4-c2e64f6b4aa4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:48.878863 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-24eb6380-b440-45c0-acb4-c2e64f6b4aa4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:48.885748 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24eb6380-b440-45c0-acb4-c2e64f6b4aa4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:48.886202 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24eb6380-b440-45c0-acb4-c2e64f6b4aa4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:48.886982 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24eb6380-b440-45c0-acb4-c2e64f6b4aa4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:48.887424 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24eb6380-b440-45c0-acb4-c2e64f6b4aa4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:49.023651 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-24eb6380-b440-45c0-acb4-c2e64f6b4aa4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:49.032206 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-24eb6380-b440-45c0-acb4-c2e64f6b4aa4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1724 microversion: 2.1 time: 0.157649 Dec 27 14:24:49.032774 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 367/698] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:48 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:49.181579 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-825a221a-ce05-44b6-bc43-fc75668d2957 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:49.182391 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-825a221a-ce05-44b6-bc43-fc75668d2957 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:49.189532 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-825a221a-ce05-44b6-bc43-fc75668d2957 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:49.189982 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-825a221a-ce05-44b6-bc43-fc75668d2957 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:49.190756 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-825a221a-ce05-44b6-bc43-fc75668d2957 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:49.191188 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-825a221a-ce05-44b6-bc43-fc75668d2957 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:49.217814 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-825a221a-ce05-44b6-bc43-fc75668d2957 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 27 14:24:49.291356 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-825a221a-ce05-44b6-bc43-fc75668d2957 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "DELETE /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 204 len: 0 microversion: 2.1 time: 0.113494 Dec 27 14:24:49.292182 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 332/699] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Dec 27 14:24:49 2021] DELETE /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 27 14:24:49.300106 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-71390d53-eb98-486c-82d1-f2714adda2d5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:49.300806 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-71390d53-eb98-486c-82d1-f2714adda2d5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:49.309149 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-71390d53-eb98-486c-82d1-f2714adda2d5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:49.309149 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-71390d53-eb98-486c-82d1-f2714adda2d5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:49.309708 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-71390d53-eb98-486c-82d1-f2714adda2d5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:49.310148 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-71390d53-eb98-486c-82d1-f2714adda2d5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:49.447101 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-71390d53-eb98-486c-82d1-f2714adda2d5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:49.454648 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3b4490fd-92e1-44a0-aee2-9ad7d58d5d34 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:49.455983 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3b4490fd-92e1-44a0-aee2-9ad7d58d5d34 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:49.462183 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-71390d53-eb98-486c-82d1-f2714adda2d5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1515 microversion: 2.1 time: 0.165645 Dec 27 14:24:49.463916 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 368/700] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:49 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:49.466741 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b4490fd-92e1-44a0-aee2-9ad7d58d5d34 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:49.468622 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b4490fd-92e1-44a0-aee2-9ad7d58d5d34 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:49.469806 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b4490fd-92e1-44a0-aee2-9ad7d58d5d34 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:49.470245 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3b4490fd-92e1-44a0-aee2-9ad7d58d5d34 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:49.554222 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3b4490fd-92e1-44a0-aee2-9ad7d58d5d34 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.104422 Dec 27 14:24:49.554863 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 333/701] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:49 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:24:49.832625 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9a308110-4931-482b-b0c7-292e69b2f982 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:49.833049 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9a308110-4931-482b-b0c7-292e69b2f982 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:49.841115 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a308110-4931-482b-b0c7-292e69b2f982 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:49.841555 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a308110-4931-482b-b0c7-292e69b2f982 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:49.842328 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a308110-4931-482b-b0c7-292e69b2f982 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:49.842752 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a308110-4931-482b-b0c7-292e69b2f982 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:49.867962 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9a308110-4931-482b-b0c7-292e69b2f982 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Going to try to terminate instance {{(pid=116105) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 27 14:24:49.950165 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9a308110-4931-482b-b0c7-292e69b2f982 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "DELETE /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 204 len: 0 microversion: 2.1 time: 0.120855 Dec 27 14:24:49.950978 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 369/702] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Dec 27 14:24:49 2021] DELETE /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 27 14:24:49.960935 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-309f7a80-b47f-4694-affb-ec5ac870f9ff tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:49.961718 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-309f7a80-b47f-4694-affb-ec5ac870f9ff tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:49.969485 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-309f7a80-b47f-4694-affb-ec5ac870f9ff tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:49.969925 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-309f7a80-b47f-4694-affb-ec5ac870f9ff tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:49.971171 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-309f7a80-b47f-4694-affb-ec5ac870f9ff tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:49.971171 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-309f7a80-b47f-4694-affb-ec5ac870f9ff tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:50.049823 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-82e4974c-31ef-4bbb-bcec-65d72b7d30cc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:50.051493 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-82e4974c-31ef-4bbb-bcec-65d72b7d30cc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:50.059822 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-82e4974c-31ef-4bbb-bcec-65d72b7d30cc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:50.059822 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-82e4974c-31ef-4bbb-bcec-65d72b7d30cc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:50.060338 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-82e4974c-31ef-4bbb-bcec-65d72b7d30cc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:50.060770 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-82e4974c-31ef-4bbb-bcec-65d72b7d30cc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:50.126013 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-309f7a80-b47f-4694-affb-ec5ac870f9ff tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:50.137052 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-309f7a80-b47f-4694-affb-ec5ac870f9ff tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1508 microversion: 2.1 time: 0.180894 Dec 27 14:24:50.138260 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 334/703] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:49 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:50.232598 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-82e4974c-31ef-4bbb-bcec-65d72b7d30cc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:50.240605 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-82e4974c-31ef-4bbb-bcec-65d72b7d30cc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1724 microversion: 2.1 time: 0.194795 Dec 27 14:24:50.241176 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 370/704] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:50 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:50.481308 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-689141f1-add3-48fb-a149-1e2b474b9995 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:50.481902 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-689141f1-add3-48fb-a149-1e2b474b9995 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:50.488297 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-689141f1-add3-48fb-a149-1e2b474b9995 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:50.488768 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-689141f1-add3-48fb-a149-1e2b474b9995 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:50.489541 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-689141f1-add3-48fb-a149-1e2b474b9995 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:50.489970 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-689141f1-add3-48fb-a149-1e2b474b9995 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:50.565836 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-99f2fdc9-c265-4db3-90d5-32862c0f4206 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:50.566881 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-99f2fdc9-c265-4db3-90d5-32862c0f4206 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:50.574636 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99f2fdc9-c265-4db3-90d5-32862c0f4206 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:50.575158 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99f2fdc9-c265-4db3-90d5-32862c0f4206 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:50.576053 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99f2fdc9-c265-4db3-90d5-32862c0f4206 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:50.576554 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99f2fdc9-c265-4db3-90d5-32862c0f4206 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:50.622150 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-689141f1-add3-48fb-a149-1e2b474b9995 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:50.629511 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-689141f1-add3-48fb-a149-1e2b474b9995 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1515 microversion: 2.1 time: 0.152734 Dec 27 14:24:50.630077 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 335/705] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:50 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:51.154619 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-13344377-7cfd-44cd-8f18-69dd348ee555 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:51.155221 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-13344377-7cfd-44cd-8f18-69dd348ee555 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:51.161932 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13344377-7cfd-44cd-8f18-69dd348ee555 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:51.162379 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13344377-7cfd-44cd-8f18-69dd348ee555 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:51.163149 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13344377-7cfd-44cd-8f18-69dd348ee555 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:51.163640 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-13344377-7cfd-44cd-8f18-69dd348ee555 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:51.293963 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-13344377-7cfd-44cd-8f18-69dd348ee555 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:51.301240 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-13344377-7cfd-44cd-8f18-69dd348ee555 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1508 microversion: 2.1 time: 0.150315 Dec 27 14:24:51.301884 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 336/706] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:51 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:51.305991 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-69431e42-9a40-45e1-a214-af2ab555a61f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:51.307435 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-69431e42-9a40-45e1-a214-af2ab555a61f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:51.312995 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-69431e42-9a40-45e1-a214-af2ab555a61f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:51.313446 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-69431e42-9a40-45e1-a214-af2ab555a61f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:51.314230 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-69431e42-9a40-45e1-a214-af2ab555a61f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:51.314667 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-69431e42-9a40-45e1-a214-af2ab555a61f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:51.445356 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-69431e42-9a40-45e1-a214-af2ab555a61f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:51.453345 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-69431e42-9a40-45e1-a214-af2ab555a61f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1724 microversion: 2.1 time: 0.150522 Dec 27 14:24:51.453911 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 337/707] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:51 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:51.645146 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b427beaa-c2b6-4e45-8558-75db1c28b0ed tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:51.645810 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b427beaa-c2b6-4e45-8558-75db1c28b0ed tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:51.652167 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b427beaa-c2b6-4e45-8558-75db1c28b0ed tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:51.652613 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b427beaa-c2b6-4e45-8558-75db1c28b0ed tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:51.653380 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b427beaa-c2b6-4e45-8558-75db1c28b0ed tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:51.653810 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b427beaa-c2b6-4e45-8558-75db1c28b0ed tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:51.784275 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b427beaa-c2b6-4e45-8558-75db1c28b0ed tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:51.792059 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b427beaa-c2b6-4e45-8558-75db1c28b0ed tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1515 microversion: 2.1 time: 0.150517 Dec 27 14:24:51.792622 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 338/708] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:51 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:52.318480 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ad413fa4-8315-4822-85d4-75b19ac2551f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:52.319078 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ad413fa4-8315-4822-85d4-75b19ac2551f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:52.325629 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad413fa4-8315-4822-85d4-75b19ac2551f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:52.326078 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad413fa4-8315-4822-85d4-75b19ac2551f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:52.326862 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad413fa4-8315-4822-85d4-75b19ac2551f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:52.327299 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad413fa4-8315-4822-85d4-75b19ac2551f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:52.456815 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ad413fa4-8315-4822-85d4-75b19ac2551f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:52.464101 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ad413fa4-8315-4822-85d4-75b19ac2551f tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1508 microversion: 2.1 time: 0.149269 Dec 27 14:24:52.464681 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 339/709] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:52 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:52.469640 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-990ef3bd-6fb8-4f67-8d78-7670d755f99f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:52.470242 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-990ef3bd-6fb8-4f67-8d78-7670d755f99f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:52.475997 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-990ef3bd-6fb8-4f67-8d78-7670d755f99f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:52.476450 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-990ef3bd-6fb8-4f67-8d78-7670d755f99f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:52.477279 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-990ef3bd-6fb8-4f67-8d78-7670d755f99f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:52.477721 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-990ef3bd-6fb8-4f67-8d78-7670d755f99f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:52.605234 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-990ef3bd-6fb8-4f67-8d78-7670d755f99f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:52.612897 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-990ef3bd-6fb8-4f67-8d78-7670d755f99f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1724 microversion: 2.1 time: 0.146499 Dec 27 14:24:52.613460 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 340/710] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:52 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:52.808951 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-67f03f26-499b-4812-a463-c303f5d11624 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:52.809593 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-67f03f26-499b-4812-a463-c303f5d11624 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:52.815728 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67f03f26-499b-4812-a463-c303f5d11624 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:52.816202 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67f03f26-499b-4812-a463-c303f5d11624 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:52.817043 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67f03f26-499b-4812-a463-c303f5d11624 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:52.817473 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-67f03f26-499b-4812-a463-c303f5d11624 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:52.947880 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-67f03f26-499b-4812-a463-c303f5d11624 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:52.955213 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-67f03f26-499b-4812-a463-c303f5d11624 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1515 microversion: 2.1 time: 0.150434 Dec 27 14:24:52.955781 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 341/711] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:52 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:53.480660 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-965b18da-9459-4454-8a91-b888ff101ec5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:53.481275 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-965b18da-9459-4454-8a91-b888ff101ec5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:53.487140 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-965b18da-9459-4454-8a91-b888ff101ec5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:53.487592 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-965b18da-9459-4454-8a91-b888ff101ec5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:53.488412 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-965b18da-9459-4454-8a91-b888ff101ec5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:53.488851 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-965b18da-9459-4454-8a91-b888ff101ec5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:53.519164 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-99f2fdc9-c265-4db3-90d5-32862c0f4206 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 2.956907 Dec 27 14:24:53.519807 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 371/712] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:50 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 2958 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:24:53.617997 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-965b18da-9459-4454-8a91-b888ff101ec5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:53.626350 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-965b18da-9459-4454-8a91-b888ff101ec5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1508 microversion: 2.1 time: 0.149362 Dec 27 14:24:53.626914 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 342/713] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:53 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:53.630640 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5adde17c-7c6e-4dc4-94dc-0bf1e4a46330 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:53.631335 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5adde17c-7c6e-4dc4-94dc-0bf1e4a46330 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:53.638434 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5adde17c-7c6e-4dc4-94dc-0bf1e4a46330 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:53.638883 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5adde17c-7c6e-4dc4-94dc-0bf1e4a46330 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:53.639657 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5adde17c-7c6e-4dc4-94dc-0bf1e4a46330 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:53.640119 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5adde17c-7c6e-4dc4-94dc-0bf1e4a46330 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:53.768331 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5adde17c-7c6e-4dc4-94dc-0bf1e4a46330 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:53.776904 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5adde17c-7c6e-4dc4-94dc-0bf1e4a46330 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1724 microversion: 2.1 time: 0.150190 Dec 27 14:24:53.777458 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 372/714] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:53 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:53.971794 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-416837ac-6965-4155-9053-fd78d37efde5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:53.972436 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-416837ac-6965-4155-9053-fd78d37efde5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:53.979263 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-416837ac-6965-4155-9053-fd78d37efde5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:53.979711 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-416837ac-6965-4155-9053-fd78d37efde5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:53.980514 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-416837ac-6965-4155-9053-fd78d37efde5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:53.980950 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-416837ac-6965-4155-9053-fd78d37efde5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:54.110360 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-416837ac-6965-4155-9053-fd78d37efde5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:54.117577 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-416837ac-6965-4155-9053-fd78d37efde5 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1515 microversion: 2.1 time: 0.149438 Dec 27 14:24:54.118140 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 343/715] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:53 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:54.531140 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-53226546-6c49-4256-883c-39707470d54f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:54.532087 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-53226546-6c49-4256-883c-39707470d54f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:54.538468 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-53226546-6c49-4256-883c-39707470d54f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:54.538915 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-53226546-6c49-4256-883c-39707470d54f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:54.539690 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-53226546-6c49-4256-883c-39707470d54f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:54.540153 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-53226546-6c49-4256-883c-39707470d54f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:54.621820 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-53226546-6c49-4256-883c-39707470d54f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.094432 Dec 27 14:24:54.625711 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 373/716] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:54 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:54.642333 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-060ee379-ccdd-494b-8f99-d05841aa3b90 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:54.642947 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-060ee379-ccdd-494b-8f99-d05841aa3b90 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:54.648888 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-060ee379-ccdd-494b-8f99-d05841aa3b90 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:54.649410 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-060ee379-ccdd-494b-8f99-d05841aa3b90 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:54.650929 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-060ee379-ccdd-494b-8f99-d05841aa3b90 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:54.651490 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-060ee379-ccdd-494b-8f99-d05841aa3b90 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:54.676647 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2c290c83-50ce-403a-b9a0-724dd70047e5 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1144383467", "imageRef": "c8bd383f-96c5-4e2b-aaa5-fabd68b307f6", "flavorRef": "452", "networks": [{"uuid": "751637e1-6a5a-45f9-829a-2ac2c9824dd1"}]}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:54.729129 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.network.neutron [None req-2c290c83-50ce-403a-b9a0-724dd70047e5 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] validate_networks() for [('751637e1-6a5a-45f9-829a-2ac2c9824dd1', None, None, None, None, None)] {{(pid=116105) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 27 14:24:54.785483 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-060ee379-ccdd-494b-8f99-d05841aa3b90 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:54.794074 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-060ee379-ccdd-494b-8f99-d05841aa3b90 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1508 microversion: 2.1 time: 0.155335 Dec 27 14:24:54.795270 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 344/717] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:54 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:54.799733 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7bddd8f7-9f59-4c5c-b015-5a177b056264 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:54.800370 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7bddd8f7-9f59-4c5c-b015-5a177b056264 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:54.806449 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7bddd8f7-9f59-4c5c-b015-5a177b056264 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:54.806907 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7bddd8f7-9f59-4c5c-b015-5a177b056264 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:54.807728 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7bddd8f7-9f59-4c5c-b015-5a177b056264 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:54.808197 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7bddd8f7-9f59-4c5c-b015-5a177b056264 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:54.937221 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7bddd8f7-9f59-4c5c-b015-5a177b056264 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:54.945074 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7bddd8f7-9f59-4c5c-b015-5a177b056264 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1724 microversion: 2.1 time: 0.148677 Dec 27 14:24:54.945649 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 345/718] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:54 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:55.133983 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d862d65e-b80d-4377-b7f7-7d932b6a2681 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:55.135276 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d862d65e-b80d-4377-b7f7-7d932b6a2681 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:55.142093 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d862d65e-b80d-4377-b7f7-7d932b6a2681 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:55.142702 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d862d65e-b80d-4377-b7f7-7d932b6a2681 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:55.144655 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d862d65e-b80d-4377-b7f7-7d932b6a2681 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:55.144759 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d862d65e-b80d-4377-b7f7-7d932b6a2681 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:55.283152 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d862d65e-b80d-4377-b7f7-7d932b6a2681 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:55.290544 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d862d65e-b80d-4377-b7f7-7d932b6a2681 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1515 microversion: 2.1 time: 0.160218 Dec 27 14:24:55.291128 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 346/719] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:55 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:55.335550 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-2c290c83-50ce-403a-b9a0-724dd70047e5 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Flavor limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 27 14:24:55.336132 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-2c290c83-50ce-403a-b9a0-724dd70047e5 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Image limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 27 14:24:55.336885 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-2c290c83-50ce-403a-b9a0-724dd70047e5 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Flavor pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 27 14:24:55.337411 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-2c290c83-50ce-403a-b9a0-724dd70047e5 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Image pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 27 14:24:55.337937 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-2c290c83-50ce-403a-b9a0-724dd70047e5 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 27 14:24:55.347191 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2c290c83-50ce-403a-b9a0-724dd70047e5 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:55.347645 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2c290c83-50ce-403a-b9a0-724dd70047e5 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:55.348490 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2c290c83-50ce-403a-b9a0-724dd70047e5 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:55.349083 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2c290c83-50ce-403a-b9a0-724dd70047e5 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:55.368411 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-2c290c83-50ce-403a-b9a0-724dd70047e5 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Getting quotas for project 6945d0284cf64136bf191e4e1ae16b37. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:24:55.373035 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-2c290c83-50ce-403a-b9a0-724dd70047e5 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Getting quotas for user eeb11dc4bf4c487a89a68500478f9e83 and project 6945d0284cf64136bf191e4e1ae16b37. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:24:55.383668 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2c290c83-50ce-403a-b9a0-724dd70047e5 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Going to run 1 instances... {{(pid=116105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 27 14:24:55.386733 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2c290c83-50ce-403a-b9a0-724dd70047e5 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c8bd383f-96c5-4e2b-aaa5-fabd68b307f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 27 14:24:55.432522 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2c290c83-50ce-403a-b9a0-724dd70047e5 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.759754 Dec 27 14:24:55.433353 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 374/720] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Dec 27 14:24:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 27 14:24:55.443289 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ead28baa-5b48-4a5e-a429-7c6e2cc43a4b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:55.443924 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ead28baa-5b48-4a5e-a429-7c6e2cc43a4b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:55.495907 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ead28baa-5b48-4a5e-a429-7c6e2cc43a4b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:55.502839 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ead28baa-5b48-4a5e-a429-7c6e2cc43a4b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1" status: 200 len: 1219 microversion: 2.1 time: 0.063234 Dec 27 14:24:55.503671 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 347/721] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:55 2021] GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:55.633506 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e15752ab-1f53-4b1b-8187-8ad0e39c5c95 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:55.634526 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e15752ab-1f53-4b1b-8187-8ad0e39c5c95 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:55.642031 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e15752ab-1f53-4b1b-8187-8ad0e39c5c95 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:55.642031 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e15752ab-1f53-4b1b-8187-8ad0e39c5c95 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:55.643087 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e15752ab-1f53-4b1b-8187-8ad0e39c5c95 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:55.643736 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e15752ab-1f53-4b1b-8187-8ad0e39c5c95 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:55.718080 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e15752ab-1f53-4b1b-8187-8ad0e39c5c95 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.087311 Dec 27 14:24:55.719873 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 375/722] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:55 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:55.804833 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-399ad1b9-92d4-4fd4-bd22-7c403ad24aa3 req-290aeb3d-b73e-48b9-8e65-f7b07f0e05de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9183a2b5-fbe1-45df-906b-e7311f3a3826", "name": "network-vif-deleted", "tag": "5f034588-3141-4425-885f-1e0f76e6fb2a"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:55.806640 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:24:55.806640 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:24:55.811299 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5eab84af-72e7-42f6-9c8e-c719fcaff488 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:55.812049 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5eab84af-72e7-42f6-9c8e-c719fcaff488 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:55.814879 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-399ad1b9-92d4-4fd4-bd22-7c403ad24aa3 req-290aeb3d-b73e-48b9-8e65-f7b07f0e05de service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:55.815323 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-399ad1b9-92d4-4fd4-bd22-7c403ad24aa3 req-290aeb3d-b73e-48b9-8e65-f7b07f0e05de service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:55.822279 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5eab84af-72e7-42f6-9c8e-c719fcaff488 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:55.823125 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5eab84af-72e7-42f6-9c8e-c719fcaff488 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:55.824073 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5eab84af-72e7-42f6-9c8e-c719fcaff488 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:55.824608 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5eab84af-72e7-42f6-9c8e-c719fcaff488 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:55.831123 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-399ad1b9-92d4-4fd4-bd22-7c403ad24aa3 req-290aeb3d-b73e-48b9-8e65-f7b07f0e05de service nova] Creating event network-vif-deleted:5f034588-3141-4425-885f-1e0f76e6fb2a for instance 9183a2b5-fbe1-45df-906b-e7311f3a3826 on hv-cinder-82301 Dec 27 14:24:55.836962 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-399ad1b9-92d4-4fd4-bd22-7c403ad24aa3 req-290aeb3d-b73e-48b9-8e65-f7b07f0e05de service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037380 Dec 27 14:24:55.838367 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 348/723] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:24:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:24:55.963319 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6bc0c940-e7c1-451b-a62e-9fa96201dbcd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:55.964298 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6bc0c940-e7c1-451b-a62e-9fa96201dbcd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:55.972590 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6bc0c940-e7c1-451b-a62e-9fa96201dbcd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:55.973467 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6bc0c940-e7c1-451b-a62e-9fa96201dbcd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:55.974809 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6bc0c940-e7c1-451b-a62e-9fa96201dbcd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:55.975402 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6bc0c940-e7c1-451b-a62e-9fa96201dbcd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:55.977512 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5eab84af-72e7-42f6-9c8e-c719fcaff488 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:55.985063 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5eab84af-72e7-42f6-9c8e-c719fcaff488 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1508 microversion: 2.1 time: 0.177928 Dec 27 14:24:55.985790 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 376/724] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:55 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:56.108969 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6bc0c940-e7c1-451b-a62e-9fa96201dbcd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:56.117215 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6bc0c940-e7c1-451b-a62e-9fa96201dbcd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1724 microversion: 2.1 time: 0.158428 Dec 27 14:24:56.117759 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 349/725] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:55 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:24:56.308098 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b0f2ae3e-ba39-4459-960d-6374cbe375e8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:56.308786 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b0f2ae3e-ba39-4459-960d-6374cbe375e8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:56.314944 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b0f2ae3e-ba39-4459-960d-6374cbe375e8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:56.315385 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b0f2ae3e-ba39-4459-960d-6374cbe375e8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:56.316193 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b0f2ae3e-ba39-4459-960d-6374cbe375e8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:56.316622 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b0f2ae3e-ba39-4459-960d-6374cbe375e8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:56.348158 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b0f2ae3e-ba39-4459-960d-6374cbe375e8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:56.348597 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b0f2ae3e-ba39-4459-960d-6374cbe375e8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:56.349105 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.objects.instance [None req-b0f2ae3e-ba39-4459-960d-6374cbe375e8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lazy-loading 'fault' on Instance uuid 9183a2b5-fbe1-45df-906b-e7311f3a3826 {{(pid=116105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:24:56.425439 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b0f2ae3e-ba39-4459-960d-6374cbe375e8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e4c89b986aa4f2690ee1587172c17cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '648321538a5a439baf7e39cee8742fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:56.434081 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b0f2ae3e-ba39-4459-960d-6374cbe375e8 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 200 len: 1308 microversion: 2.1 time: 0.130345 Dec 27 14:24:56.443923 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 377/726] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:56 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 1308 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:56.520521 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-57f96355-d8a4-44c9-98dc-365d285a2bfc tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:56.521126 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-57f96355-d8a4-44c9-98dc-365d285a2bfc tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:56.527536 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-57f96355-d8a4-44c9-98dc-365d285a2bfc tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:56.528063 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-57f96355-d8a4-44c9-98dc-365d285a2bfc tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:56.528849 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-57f96355-d8a4-44c9-98dc-365d285a2bfc tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:56.529281 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-57f96355-d8a4-44c9-98dc-365d285a2bfc tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:56.588745 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-57f96355-d8a4-44c9-98dc-365d285a2bfc tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:56.596013 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-57f96355-d8a4-44c9-98dc-365d285a2bfc tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1" status: 200 len: 1271 microversion: 2.1 time: 0.079095 Dec 27 14:24:56.596576 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 350/727] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:56 2021] GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 => generated 1271 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:56.734355 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-186d4bd6-e068-43ff-89de-780d3e7fc2b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:56.735422 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-186d4bd6-e068-43ff-89de-780d3e7fc2b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:56.741607 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-186d4bd6-e068-43ff-89de-780d3e7fc2b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:56.742299 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-186d4bd6-e068-43ff-89de-780d3e7fc2b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:56.743245 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-186d4bd6-e068-43ff-89de-780d3e7fc2b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:56.743912 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-186d4bd6-e068-43ff-89de-780d3e7fc2b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:56.819577 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-186d4bd6-e068-43ff-89de-780d3e7fc2b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.091464 Dec 27 14:24:56.823285 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 378/728] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:56 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:57.004535 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d9f10526-4707-4092-9b1a-e7842fc21f93 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:57.005207 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d9f10526-4707-4092-9b1a-e7842fc21f93 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:57.011716 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d9f10526-4707-4092-9b1a-e7842fc21f93 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:57.012193 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d9f10526-4707-4092-9b1a-e7842fc21f93 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:57.013898 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d9f10526-4707-4092-9b1a-e7842fc21f93 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:57.014478 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d9f10526-4707-4092-9b1a-e7842fc21f93 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:57.054435 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d9f10526-4707-4092-9b1a-e7842fc21f93 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:57.054886 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d9f10526-4707-4092-9b1a-e7842fc21f93 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:57.055331 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-d9f10526-4707-4092-9b1a-e7842fc21f93 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lazy-loading 'fault' on Instance uuid 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:24:57.121542 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d9f10526-4707-4092-9b1a-e7842fc21f93 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:57.133829 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d9f10526-4707-4092-9b1a-e7842fc21f93 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 200 len: 1312 microversion: 2.1 time: 0.130505 Dec 27 14:24:57.135411 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-53681614-2e0b-4c2f-a39b-7eb5d0c03890 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:57.136222 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-53681614-2e0b-4c2f-a39b-7eb5d0c03890 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:57.136714 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 351/729] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:56 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 1312 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:57.146098 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-53681614-2e0b-4c2f-a39b-7eb5d0c03890 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:57.146563 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-53681614-2e0b-4c2f-a39b-7eb5d0c03890 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:57.147337 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-53681614-2e0b-4c2f-a39b-7eb5d0c03890 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:57.147797 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-53681614-2e0b-4c2f-a39b-7eb5d0c03890 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:57.281231 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-53681614-2e0b-4c2f-a39b-7eb5d0c03890 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:57.289532 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-53681614-2e0b-4c2f-a39b-7eb5d0c03890 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1724 microversion: 2.1 time: 0.158726 Dec 27 14:24:57.290097 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 379/730] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:57 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:57.453241 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-79dd9c39-2dde-4ef7-ab4d-964d9260dc34 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:57.454079 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-79dd9c39-2dde-4ef7-ab4d-964d9260dc34 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] [instance: 9183a2b5-fbe1-45df-906b-e7311f3a3826] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:57.463789 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-79dd9c39-2dde-4ef7-ab4d-964d9260dc34 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:57.464316 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-79dd9c39-2dde-4ef7-ab4d-964d9260dc34 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:57.465279 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-79dd9c39-2dde-4ef7-ab4d-964d9260dc34 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:57.466429 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-79dd9c39-2dde-4ef7-ab4d-964d9260dc34 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:57.484080 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-79dd9c39-2dde-4ef7-ab4d-964d9260dc34 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] HTTP exception thrown: Instance 9183a2b5-fbe1-45df-906b-e7311f3a3826 could not be found. Dec 27 14:24:57.484981 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-79dd9c39-2dde-4ef7-ab4d-964d9260dc34 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] Returning 404 to user: Instance 9183a2b5-fbe1-45df-906b-e7311f3a3826 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:24:57.485836 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-79dd9c39-2dde-4ef7-ab4d-964d9260dc34 tempest-AttachVolumeNegativeTest-41004951 tempest-AttachVolumeNegativeTest-41004951-project] 10.222.0.37 "GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826" status: 404 len: 111 microversion: 2.1 time: 0.038791 Dec 27 14:24:57.486527 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 352/731] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:57 2021] GET /compute/v2.1/servers/9183a2b5-fbe1-45df-906b-e7311f3a3826 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:24:57.613495 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3c0a5823-a73c-4d18-908f-95a98fe49ec0 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:57.614107 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3c0a5823-a73c-4d18-908f-95a98fe49ec0 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:57.620966 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3c0a5823-a73c-4d18-908f-95a98fe49ec0 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:57.621419 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3c0a5823-a73c-4d18-908f-95a98fe49ec0 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:57.622214 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3c0a5823-a73c-4d18-908f-95a98fe49ec0 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:57.622649 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3c0a5823-a73c-4d18-908f-95a98fe49ec0 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:57.764774 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3c0a5823-a73c-4d18-908f-95a98fe49ec0 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:57.772002 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3c0a5823-a73c-4d18-908f-95a98fe49ec0 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1" status: 200 len: 1319 microversion: 2.1 time: 0.162340 Dec 27 14:24:57.772566 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 380/732] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:57 2021] GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:57.834231 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-01bf51b2-e450-4e41-8fd4-e58726263977 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:57.835262 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-01bf51b2-e450-4e41-8fd4-e58726263977 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:57.841821 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-01bf51b2-e450-4e41-8fd4-e58726263977 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:57.842264 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-01bf51b2-e450-4e41-8fd4-e58726263977 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:57.843257 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-01bf51b2-e450-4e41-8fd4-e58726263977 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:57.843689 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-01bf51b2-e450-4e41-8fd4-e58726263977 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:57.852116 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-9f19ae14-c1d3-483c-84e7-c705af957065 req-cbcca43b-08b3-4a5f-ba2f-18de2e789783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c", "name": "network-vif-deleted", "tag": "8ec9ce5c-8ee9-4fb6-8eb7-caec5c408fc1"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:57.854617 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:24:57.854617 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:24:57.861978 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-9f19ae14-c1d3-483c-84e7-c705af957065 req-cbcca43b-08b3-4a5f-ba2f-18de2e789783 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:57.862497 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-9f19ae14-c1d3-483c-84e7-c705af957065 req-cbcca43b-08b3-4a5f-ba2f-18de2e789783 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:57.875586 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-9f19ae14-c1d3-483c-84e7-c705af957065 req-cbcca43b-08b3-4a5f-ba2f-18de2e789783 service nova] Creating event network-vif-deleted:8ec9ce5c-8ee9-4fb6-8eb7-caec5c408fc1 for instance 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c on hv-cinder-82301 Dec 27 14:24:57.880745 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-9f19ae14-c1d3-483c-84e7-c705af957065 req-cbcca43b-08b3-4a5f-ba2f-18de2e789783 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032331 Dec 27 14:24:57.881339 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 381/733] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:24:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:24:57.912349 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-01bf51b2-e450-4e41-8fd4-e58726263977 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.081771 Dec 27 14:24:57.913125 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 353/734] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:57 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:58.152744 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-72af626d-3fb2-4d6b-ac57-531c482a94c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:58.153477 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-72af626d-3fb2-4d6b-ac57-531c482a94c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:58.159821 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72af626d-3fb2-4d6b-ac57-531c482a94c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:58.160306 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72af626d-3fb2-4d6b-ac57-531c482a94c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:58.161084 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72af626d-3fb2-4d6b-ac57-531c482a94c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:58.161524 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72af626d-3fb2-4d6b-ac57-531c482a94c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:58.175401 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-72af626d-3fb2-4d6b-ac57-531c482a94c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] HTTP exception thrown: Instance 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c could not be found. Dec 27 14:24:58.176043 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-72af626d-3fb2-4d6b-ac57-531c482a94c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Returning 404 to user: Instance 7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:24:58.176852 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-72af626d-3fb2-4d6b-ac57-531c482a94c5 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c" status: 404 len: 111 microversion: 2.1 time: 0.028687 Dec 27 14:24:58.177399 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 382/735] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:58 2021] GET /compute/v2.1/servers/7cd70e5f-3b1e-4b99-ada1-0bc4d6fbe96c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:24:58.186175 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0510070b-5663-4937-8408-6b86dd1d8f71 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:58.186756 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0510070b-5663-4937-8408-6b86dd1d8f71 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:58.193581 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0510070b-5663-4937-8408-6b86dd1d8f71 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:58.194031 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0510070b-5663-4937-8408-6b86dd1d8f71 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:58.194818 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0510070b-5663-4937-8408-6b86dd1d8f71 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:58.195253 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0510070b-5663-4937-8408-6b86dd1d8f71 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:58.220356 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0510070b-5663-4937-8408-6b86dd1d8f71 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 27 14:24:58.295092 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0510070b-5663-4937-8408-6b86dd1d8f71 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "DELETE /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 204 len: 0 microversion: 2.1 time: 0.112664 Dec 27 14:24:58.296048 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 354/736] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Dec 27 14:24:58 2021] DELETE /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 27 14:24:58.304014 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-aa1eb286-befd-47fd-ae10-b65b510a1220 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:58.305003 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-aa1eb286-befd-47fd-ae10-b65b510a1220 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:58.310368 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-add01a7a-2f19-42ad-9c1c-0ede8836ac02 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:58.311743 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa1eb286-befd-47fd-ae10-b65b510a1220 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:58.312194 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-add01a7a-2f19-42ad-9c1c-0ede8836ac02 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:58.312349 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa1eb286-befd-47fd-ae10-b65b510a1220 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:58.313222 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa1eb286-befd-47fd-ae10-b65b510a1220 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:58.313721 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa1eb286-befd-47fd-ae10-b65b510a1220 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:58.318366 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-add01a7a-2f19-42ad-9c1c-0ede8836ac02 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:58.318815 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-add01a7a-2f19-42ad-9c1c-0ede8836ac02 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:58.319604 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-add01a7a-2f19-42ad-9c1c-0ede8836ac02 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:58.320062 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-add01a7a-2f19-42ad-9c1c-0ede8836ac02 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:58.454377 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-aa1eb286-befd-47fd-ae10-b65b510a1220 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:58.463146 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-aa1eb286-befd-47fd-ae10-b65b510a1220 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1521 microversion: 2.1 time: 0.162891 Dec 27 14:24:58.463719 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 383/737] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:58 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:58.664638 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-add01a7a-2f19-42ad-9c1c-0ede8836ac02 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:58.674697 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-add01a7a-2f19-42ad-9c1c-0ede8836ac02 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1701 microversion: 2.1 time: 0.370896 Dec 27 14:24:58.675465 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 355/738] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:58 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1701 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:58.691886 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-13e260b3-3287-4e8a-b113-461d96d1e97a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:58.698206 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-13e260b3-3287-4e8a-b113-461d96d1e97a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:58.698663 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-13e260b3-3287-4e8a-b113-461d96d1e97a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:58.725436 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-13e260b3-3287-4e8a-b113-461d96d1e97a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Going to try to start instance {{(pid=116105) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 27 14:24:58.771819 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-13e260b3-3287-4e8a-b113-461d96d1e97a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 202 len: 0 microversion: 2.1 time: 0.083383 Dec 27 14:24:58.774283 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 384/739] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:24:58 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:58.792364 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-24c9ff11-ff36-4e1b-8ebe-60dd56d34132 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:58.794043 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-24c9ff11-ff36-4e1b-8ebe-60dd56d34132 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:58.801943 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7134c4e7-c9d0-425a-90f4-da2026538807 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:58.803332 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7134c4e7-c9d0-425a-90f4-da2026538807 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:58.807088 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24c9ff11-ff36-4e1b-8ebe-60dd56d34132 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:58.807562 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24c9ff11-ff36-4e1b-8ebe-60dd56d34132 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:58.808652 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24c9ff11-ff36-4e1b-8ebe-60dd56d34132 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:58.809503 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24c9ff11-ff36-4e1b-8ebe-60dd56d34132 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:58.820986 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7134c4e7-c9d0-425a-90f4-da2026538807 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:58.821763 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7134c4e7-c9d0-425a-90f4-da2026538807 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:58.822822 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7134c4e7-c9d0-425a-90f4-da2026538807 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:58.825107 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7134c4e7-c9d0-425a-90f4-da2026538807 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:59.010207 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-24c9ff11-ff36-4e1b-8ebe-60dd56d34132 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:59.018148 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-24c9ff11-ff36-4e1b-8ebe-60dd56d34132 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1" status: 200 len: 1319 microversion: 2.1 time: 0.231830 Dec 27 14:24:59.018734 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 385/740] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:58 2021] GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:59.024023 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-8c1a9f02-1fcd-428a-b4da-c7404668c963 req-465899b0-64a1-4700-bce4-63503821c32a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6b99852-a0cc-44d9-8da9-2fbdd2d580f1", "tag": "2788dd5b-31c5-42aa-ad4a-fbce4daa2d80"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:59.026200 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:24:59.026200 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:24:59.034434 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-8c1a9f02-1fcd-428a-b4da-c7404668c963 req-465899b0-64a1-4700-bce4-63503821c32a service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:59.034881 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-8c1a9f02-1fcd-428a-b4da-c7404668c963 req-465899b0-64a1-4700-bce4-63503821c32a service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:59.046958 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-8c1a9f02-1fcd-428a-b4da-c7404668c963 req-465899b0-64a1-4700-bce4-63503821c32a service nova] Creating event network-changed:2788dd5b-31c5-42aa-ad4a-fbce4daa2d80 for instance c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 on hv-cinder-82301 Dec 27 14:24:59.051816 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-8c1a9f02-1fcd-428a-b4da-c7404668c963 req-465899b0-64a1-4700-bce4-63503821c32a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031796 Dec 27 14:24:59.058833 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 386/741] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:24:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:24:59.064469 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-37070198-f4bb-4dcd-a924-2595fc3a9a73 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:24:59.065574 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-37070198-f4bb-4dcd-a924-2595fc3a9a73 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:59.071588 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-37070198-f4bb-4dcd-a924-2595fc3a9a73 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:59.072085 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-37070198-f4bb-4dcd-a924-2595fc3a9a73 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:59.072874 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-37070198-f4bb-4dcd-a924-2595fc3a9a73 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:59.073304 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-37070198-f4bb-4dcd-a924-2595fc3a9a73 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:59.143986 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-37070198-f4bb-4dcd-a924-2595fc3a9a73 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.083082 Dec 27 14:24:59.144274 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 387/742] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:24:59 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:24:59.178898 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7134c4e7-c9d0-425a-90f4-da2026538807 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:59.189006 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7134c4e7-c9d0-425a-90f4-da2026538807 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1710 microversion: 2.1 time: 0.409357 Dec 27 14:24:59.190895 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 356/743] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:58 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1710 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:24:59.482760 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1e1c4eb2-5349-498d-8ae2-ed51681aaaee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:24:59.484121 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1e1c4eb2-5349-498d-8ae2-ed51681aaaee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:24:59.494205 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1e1c4eb2-5349-498d-8ae2-ed51681aaaee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:59.494959 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1e1c4eb2-5349-498d-8ae2-ed51681aaaee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:59.496466 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1e1c4eb2-5349-498d-8ae2-ed51681aaaee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:24:59.497380 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1e1c4eb2-5349-498d-8ae2-ed51681aaaee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:24:59.668828 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1e1c4eb2-5349-498d-8ae2-ed51681aaaee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:24:59.676717 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1e1c4eb2-5349-498d-8ae2-ed51681aaaee tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1521 microversion: 2.1 time: 0.199370 Dec 27 14:24:59.677752 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 388/744] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:24:59 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:25:00.036375 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9470c027-e9ef-4679-b509-cb4de525e606 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:00.036988 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9470c027-e9ef-4679-b509-cb4de525e606 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:00.043377 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9470c027-e9ef-4679-b509-cb4de525e606 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:00.043830 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9470c027-e9ef-4679-b509-cb4de525e606 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:00.044686 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9470c027-e9ef-4679-b509-cb4de525e606 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:00.045121 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9470c027-e9ef-4679-b509-cb4de525e606 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:00.155123 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5dfbe96c-b35f-4104-90a3-3f7896f37555 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:00.156965 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5dfbe96c-b35f-4104-90a3-3f7896f37555 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:00.162995 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5dfbe96c-b35f-4104-90a3-3f7896f37555 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:00.163599 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5dfbe96c-b35f-4104-90a3-3f7896f37555 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:00.164595 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5dfbe96c-b35f-4104-90a3-3f7896f37555 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:00.165027 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5dfbe96c-b35f-4104-90a3-3f7896f37555 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:00.183371 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9470c027-e9ef-4679-b509-cb4de525e606 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:00.191375 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9470c027-e9ef-4679-b509-cb4de525e606 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1" status: 200 len: 1319 microversion: 2.1 time: 0.160915 Dec 27 14:25:00.192164 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 357/745] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:00 2021] GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:25:00.206215 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-667f4c90-2a25-4aca-94d8-e3215264a7bf tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:00.206831 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-667f4c90-2a25-4aca-94d8-e3215264a7bf tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:00.213926 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-667f4c90-2a25-4aca-94d8-e3215264a7bf tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:00.214387 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-667f4c90-2a25-4aca-94d8-e3215264a7bf tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:00.215187 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-667f4c90-2a25-4aca-94d8-e3215264a7bf tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:00.215629 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-667f4c90-2a25-4aca-94d8-e3215264a7bf tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:00.286092 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5dfbe96c-b35f-4104-90a3-3f7896f37555 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.134482 Dec 27 14:25:00.287277 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 389/746] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:00 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:00.356415 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-667f4c90-2a25-4aca-94d8-e3215264a7bf tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:00.364487 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-667f4c90-2a25-4aca-94d8-e3215264a7bf tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1710 microversion: 2.1 time: 0.161777 Dec 27 14:25:00.365053 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 358/747] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:00 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:25:00.694062 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f93a6d64-3237-493c-a2af-09c93ca27b91 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:00.694765 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f93a6d64-3237-493c-a2af-09c93ca27b91 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:00.701706 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f93a6d64-3237-493c-a2af-09c93ca27b91 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:00.702248 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f93a6d64-3237-493c-a2af-09c93ca27b91 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:00.703042 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f93a6d64-3237-493c-a2af-09c93ca27b91 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:00.703475 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f93a6d64-3237-493c-a2af-09c93ca27b91 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:00.839752 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f93a6d64-3237-493c-a2af-09c93ca27b91 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:00.847916 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f93a6d64-3237-493c-a2af-09c93ca27b91 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1521 microversion: 2.1 time: 0.157688 Dec 27 14:25:00.848567 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 390/748] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:00 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:25:01.208890 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-55f4718c-6714-43d9-a39b-900f45ae55cb tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:01.209423 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-55f4718c-6714-43d9-a39b-900f45ae55cb tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:01.215769 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55f4718c-6714-43d9-a39b-900f45ae55cb tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:01.216257 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55f4718c-6714-43d9-a39b-900f45ae55cb tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:01.217049 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55f4718c-6714-43d9-a39b-900f45ae55cb tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:01.217488 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-55f4718c-6714-43d9-a39b-900f45ae55cb tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:01.296925 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f971cf90-a4aa-4dd3-8842-12ed2e2d847d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:01.297729 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f971cf90-a4aa-4dd3-8842-12ed2e2d847d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:01.304078 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f971cf90-a4aa-4dd3-8842-12ed2e2d847d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:01.304536 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f971cf90-a4aa-4dd3-8842-12ed2e2d847d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:01.305325 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f971cf90-a4aa-4dd3-8842-12ed2e2d847d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:01.306313 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f971cf90-a4aa-4dd3-8842-12ed2e2d847d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:01.351584 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-55f4718c-6714-43d9-a39b-900f45ae55cb tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:01.358923 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-55f4718c-6714-43d9-a39b-900f45ae55cb tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1" status: 200 len: 1319 microversion: 2.1 time: 0.153869 Dec 27 14:25:01.359476 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 359/749] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:01 2021] GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:25:01.381815 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b1c16bd9-a140-44fc-ac38-dac1313e09dd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:01.382408 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b1c16bd9-a140-44fc-ac38-dac1313e09dd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:01.388822 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1c16bd9-a140-44fc-ac38-dac1313e09dd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:01.389266 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1c16bd9-a140-44fc-ac38-dac1313e09dd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:01.390037 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1c16bd9-a140-44fc-ac38-dac1313e09dd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:01.390468 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1c16bd9-a140-44fc-ac38-dac1313e09dd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:01.479940 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f971cf90-a4aa-4dd3-8842-12ed2e2d847d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.186600 Dec 27 14:25:01.483776 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 391/750] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:01 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:25:01.521743 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b1c16bd9-a140-44fc-ac38-dac1313e09dd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:01.529520 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b1c16bd9-a140-44fc-ac38-dac1313e09dd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1714 microversion: 2.1 time: 0.151091 Dec 27 14:25:01.530074 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 360/751] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:01 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1714 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:25:01.865082 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e28d4e69-5565-48a0-b650-78547c4648b6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:01.865701 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e28d4e69-5565-48a0-b650-78547c4648b6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:01.873224 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e28d4e69-5565-48a0-b650-78547c4648b6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:01.873674 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e28d4e69-5565-48a0-b650-78547c4648b6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:01.874453 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e28d4e69-5565-48a0-b650-78547c4648b6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:01.874896 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e28d4e69-5565-48a0-b650-78547c4648b6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:02.006391 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e28d4e69-5565-48a0-b650-78547c4648b6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:02.013921 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e28d4e69-5565-48a0-b650-78547c4648b6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1521 microversion: 2.1 time: 0.152876 Dec 27 14:25:02.014479 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 392/752] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:01 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:25:02.376791 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a13aaf55-6051-4b6f-8c4a-a5260a8cf1f0 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:02.377402 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a13aaf55-6051-4b6f-8c4a-a5260a8cf1f0 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:02.385352 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a13aaf55-6051-4b6f-8c4a-a5260a8cf1f0 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:02.385988 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a13aaf55-6051-4b6f-8c4a-a5260a8cf1f0 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:02.386790 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a13aaf55-6051-4b6f-8c4a-a5260a8cf1f0 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:02.387863 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a13aaf55-6051-4b6f-8c4a-a5260a8cf1f0 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:02.490984 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-81614e1b-c1f0-45d4-a2fc-7f484ae14a7d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:02.491935 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-81614e1b-c1f0-45d4-a2fc-7f484ae14a7d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:02.498228 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-81614e1b-c1f0-45d4-a2fc-7f484ae14a7d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:02.498676 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-81614e1b-c1f0-45d4-a2fc-7f484ae14a7d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:02.499458 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-81614e1b-c1f0-45d4-a2fc-7f484ae14a7d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:02.499919 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-81614e1b-c1f0-45d4-a2fc-7f484ae14a7d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:02.523038 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a13aaf55-6051-4b6f-8c4a-a5260a8cf1f0 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:02.531328 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a13aaf55-6051-4b6f-8c4a-a5260a8cf1f0 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1" status: 200 len: 1319 microversion: 2.1 time: 0.158215 Dec 27 14:25:02.531911 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 361/753] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:02 2021] GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:25:02.572817 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-81614e1b-c1f0-45d4-a2fc-7f484ae14a7d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.085261 Dec 27 14:25:02.573438 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 393/754] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:02 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:03.030507 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0b18ffa7-7c67-4638-a7c3-e0a38c322ea6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:03.031400 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0b18ffa7-7c67-4638-a7c3-e0a38c322ea6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:03.037455 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0b18ffa7-7c67-4638-a7c3-e0a38c322ea6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:03.037912 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0b18ffa7-7c67-4638-a7c3-e0a38c322ea6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:03.038695 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0b18ffa7-7c67-4638-a7c3-e0a38c322ea6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:03.039135 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0b18ffa7-7c67-4638-a7c3-e0a38c322ea6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:03.169931 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0b18ffa7-7c67-4638-a7c3-e0a38c322ea6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:03.177448 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0b18ffa7-7c67-4638-a7c3-e0a38c322ea6 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1521 microversion: 2.1 time: 0.150651 Dec 27 14:25:03.178002 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 362/755] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:03 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:25:03.548341 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-096a12ba-ad1e-4a33-8eac-fc5a53484205 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:03.549031 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-096a12ba-ad1e-4a33-8eac-fc5a53484205 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:03.556388 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-096a12ba-ad1e-4a33-8eac-fc5a53484205 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:03.556798 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-096a12ba-ad1e-4a33-8eac-fc5a53484205 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:03.557552 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-096a12ba-ad1e-4a33-8eac-fc5a53484205 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:03.557971 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-096a12ba-ad1e-4a33-8eac-fc5a53484205 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:03.589339 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6eb614ee-d1f2-4b8c-9b05-31044c938f5a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:03.590330 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6eb614ee-d1f2-4b8c-9b05-31044c938f5a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:03.596375 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6eb614ee-d1f2-4b8c-9b05-31044c938f5a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:03.596824 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6eb614ee-d1f2-4b8c-9b05-31044c938f5a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:03.597605 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6eb614ee-d1f2-4b8c-9b05-31044c938f5a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:03.598038 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6eb614ee-d1f2-4b8c-9b05-31044c938f5a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:03.693498 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6eb614ee-d1f2-4b8c-9b05-31044c938f5a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.112519 Dec 27 14:25:03.695612 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 363/756] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:03 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:03.707088 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-096a12ba-ad1e-4a33-8eac-fc5a53484205 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:03.715132 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-096a12ba-ad1e-4a33-8eac-fc5a53484205 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1" status: 200 len: 1319 microversion: 2.1 time: 0.170619 Dec 27 14:25:03.715767 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 394/757] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:03 2021] GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:25:04.196957 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6407423d-40c2-4587-941f-e15b1ab470e4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:04.197658 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6407423d-40c2-4587-941f-e15b1ab470e4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:04.204618 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6407423d-40c2-4587-941f-e15b1ab470e4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:04.205073 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6407423d-40c2-4587-941f-e15b1ab470e4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:04.205864 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6407423d-40c2-4587-941f-e15b1ab470e4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:04.206308 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6407423d-40c2-4587-941f-e15b1ab470e4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:04.339286 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6407423d-40c2-4587-941f-e15b1ab470e4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:04.346642 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6407423d-40c2-4587-941f-e15b1ab470e4 tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1521 microversion: 2.1 time: 0.153786 Dec 27 14:25:04.347200 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 364/758] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:04 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:25:04.705595 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2251bd37-473b-4986-8edd-49faecd1f5df tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:04.706504 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2251bd37-473b-4986-8edd-49faecd1f5df tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:04.713403 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2251bd37-473b-4986-8edd-49faecd1f5df tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:04.713830 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2251bd37-473b-4986-8edd-49faecd1f5df tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:04.714592 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2251bd37-473b-4986-8edd-49faecd1f5df tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:04.715020 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2251bd37-473b-4986-8edd-49faecd1f5df tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:04.731949 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ddd3414b-4fa7-4be6-92b6-bc1b84a3e7b2 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:04.732561 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ddd3414b-4fa7-4be6-92b6-bc1b84a3e7b2 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:04.738741 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ddd3414b-4fa7-4be6-92b6-bc1b84a3e7b2 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:04.739183 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ddd3414b-4fa7-4be6-92b6-bc1b84a3e7b2 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:04.739988 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ddd3414b-4fa7-4be6-92b6-bc1b84a3e7b2 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:04.740424 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ddd3414b-4fa7-4be6-92b6-bc1b84a3e7b2 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:04.869759 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ddd3414b-4fa7-4be6-92b6-bc1b84a3e7b2 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:04.876886 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ddd3414b-4fa7-4be6-92b6-bc1b84a3e7b2 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1" status: 200 len: 1319 microversion: 2.1 time: 0.148691 Dec 27 14:25:04.877439 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 365/759] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:04 2021] GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:25:05.363908 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c344532b-2b53-4511-a686-90a2b128f41b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:05.364429 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c344532b-2b53-4511-a686-90a2b128f41b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:05.371355 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c344532b-2b53-4511-a686-90a2b128f41b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:05.371799 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c344532b-2b53-4511-a686-90a2b128f41b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:05.372598 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c344532b-2b53-4511-a686-90a2b128f41b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:05.373029 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c344532b-2b53-4511-a686-90a2b128f41b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:05.504526 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c344532b-2b53-4511-a686-90a2b128f41b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:05.511969 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c344532b-2b53-4511-a686-90a2b128f41b tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1521 microversion: 2.1 time: 0.151746 Dec 27 14:25:05.512528 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 366/760] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:05 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:25:05.893833 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a61dcbc3-72ce-4495-92c2-f81ef83015ec tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:05.894528 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a61dcbc3-72ce-4495-92c2-f81ef83015ec tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:05.901239 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a61dcbc3-72ce-4495-92c2-f81ef83015ec tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:05.901700 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a61dcbc3-72ce-4495-92c2-f81ef83015ec tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:05.902461 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a61dcbc3-72ce-4495-92c2-f81ef83015ec tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:05.902892 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a61dcbc3-72ce-4495-92c2-f81ef83015ec tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:06.029817 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a61dcbc3-72ce-4495-92c2-f81ef83015ec tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:06.037235 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a61dcbc3-72ce-4495-92c2-f81ef83015ec tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1" status: 200 len: 1319 microversion: 2.1 time: 0.147020 Dec 27 14:25:06.037796 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 367/761] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:05 2021] GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:25:06.528611 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-94b97d62-b446-410c-bbee-fc13b57b90bd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:06.529210 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-94b97d62-b446-410c-bbee-fc13b57b90bd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:06.535440 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-94b97d62-b446-410c-bbee-fc13b57b90bd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:06.535920 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-94b97d62-b446-410c-bbee-fc13b57b90bd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:06.536700 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-94b97d62-b446-410c-bbee-fc13b57b90bd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:06.537137 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-94b97d62-b446-410c-bbee-fc13b57b90bd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:06.665986 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-94b97d62-b446-410c-bbee-fc13b57b90bd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:06.673662 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-94b97d62-b446-410c-bbee-fc13b57b90bd tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1521 microversion: 2.1 time: 0.148906 Dec 27 14:25:06.674297 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 368/762] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:06 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:25:07.054361 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b19841e2-99b7-4ec3-9534-51d0d0b77a54 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:07.054976 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b19841e2-99b7-4ec3-9534-51d0d0b77a54 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:07.062560 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b19841e2-99b7-4ec3-9534-51d0d0b77a54 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:07.063177 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b19841e2-99b7-4ec3-9534-51d0d0b77a54 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:07.064000 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b19841e2-99b7-4ec3-9534-51d0d0b77a54 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:07.064447 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b19841e2-99b7-4ec3-9534-51d0d0b77a54 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:07.205629 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b19841e2-99b7-4ec3-9534-51d0d0b77a54 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:07.212969 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b19841e2-99b7-4ec3-9534-51d0d0b77a54 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1" status: 200 len: 1319 microversion: 2.1 time: 0.162205 Dec 27 14:25:07.213760 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 369/763] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:07 2021] GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:25:07.690623 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-907293f8-7862-4f36-9df1-6dd2bb7b227c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:07.691244 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-907293f8-7862-4f36-9df1-6dd2bb7b227c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:07.697460 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-907293f8-7862-4f36-9df1-6dd2bb7b227c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:07.697917 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-907293f8-7862-4f36-9df1-6dd2bb7b227c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:07.698717 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-907293f8-7862-4f36-9df1-6dd2bb7b227c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:07.699155 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-907293f8-7862-4f36-9df1-6dd2bb7b227c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:07.834095 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-907293f8-7862-4f36-9df1-6dd2bb7b227c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:07.841376 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-907293f8-7862-4f36-9df1-6dd2bb7b227c tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1521 microversion: 2.1 time: 0.154376 Dec 27 14:25:07.841943 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 370/764] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:07 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:25:08.176003 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2251bd37-473b-4986-8edd-49faecd1f5df tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 3.473829 Dec 27 14:25:08.176742 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 395/765] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:04 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 3475 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:08.230397 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6d81a64a-a88b-417b-a474-6579ab47916a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:08.231035 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6d81a64a-a88b-417b-a474-6579ab47916a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:08.237411 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d81a64a-a88b-417b-a474-6579ab47916a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:08.237969 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d81a64a-a88b-417b-a474-6579ab47916a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:08.238838 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d81a64a-a88b-417b-a474-6579ab47916a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:08.239348 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6d81a64a-a88b-417b-a474-6579ab47916a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:08.465092 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6d81a64a-a88b-417b-a474-6579ab47916a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:08.472318 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6d81a64a-a88b-417b-a474-6579ab47916a tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1" status: 200 len: 1319 microversion: 2.1 time: 0.246035 Dec 27 14:25:08.472882 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 371/766] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:08 2021] GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:25:08.750300 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-6fb35846-c4a7-41e0-acf7-8d90b21a41d7 req-dbb9284d-ca93-4524-a899-6915ace2aefc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8520422d-f3a9-443c-9e9a-12fb03ef1bcc", "name": "network-vif-deleted", "tag": "43013b38-d0e6-4557-ae2b-adff54b730ab"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:08.751986 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:25:08.751986 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:25:08.760543 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-6fb35846-c4a7-41e0-acf7-8d90b21a41d7 req-dbb9284d-ca93-4524-a899-6915ace2aefc service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:08.760987 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-6fb35846-c4a7-41e0-acf7-8d90b21a41d7 req-dbb9284d-ca93-4524-a899-6915ace2aefc service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:08.771512 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-6fb35846-c4a7-41e0-acf7-8d90b21a41d7 req-dbb9284d-ca93-4524-a899-6915ace2aefc service nova] Creating event network-vif-deleted:43013b38-d0e6-4557-ae2b-adff54b730ab for instance 8520422d-f3a9-443c-9e9a-12fb03ef1bcc on hv-cinder-82301 Dec 27 14:25:08.777052 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-6fb35846-c4a7-41e0-acf7-8d90b21a41d7 req-dbb9284d-ca93-4524-a899-6915ace2aefc service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030691 Dec 27 14:25:08.777621 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 396/767] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:25:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:25:08.858641 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8f7f144a-c6eb-42d5-9865-012f7f153b9d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:08.859246 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8f7f144a-c6eb-42d5-9865-012f7f153b9d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:08.865073 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8f7f144a-c6eb-42d5-9865-012f7f153b9d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:08.865517 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8f7f144a-c6eb-42d5-9865-012f7f153b9d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:08.866295 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8f7f144a-c6eb-42d5-9865-012f7f153b9d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:08.866727 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8f7f144a-c6eb-42d5-9865-012f7f153b9d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:08.927711 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8f7f144a-c6eb-42d5-9865-012f7f153b9d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58ff109f2ce44078a5cd96cc901ffcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5516ca8550bb4056a7966db3f506971b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:08.935342 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8f7f144a-c6eb-42d5-9865-012f7f153b9d tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 200 len: 1479 microversion: 2.1 time: 0.080345 Dec 27 14:25:08.935923 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 372/768] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:08 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 1479 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:25:09.188263 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a8381d28-7d6f-4360-a0c4-08630fc18cf9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:09.189257 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a8381d28-7d6f-4360-a0c4-08630fc18cf9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:09.195731 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a8381d28-7d6f-4360-a0c4-08630fc18cf9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:09.196703 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a8381d28-7d6f-4360-a0c4-08630fc18cf9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:09.197629 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a8381d28-7d6f-4360-a0c4-08630fc18cf9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:09.198066 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a8381d28-7d6f-4360-a0c4-08630fc18cf9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:09.273420 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a8381d28-7d6f-4360-a0c4-08630fc18cf9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.089056 Dec 27 14:25:09.277014 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 397/769] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:09 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:09.489344 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-edbdc9ca-28c4-441d-834c-b8d7cc660fd4 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:09.489991 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-edbdc9ca-28c4-441d-834c-b8d7cc660fd4 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:09.496970 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-edbdc9ca-28c4-441d-834c-b8d7cc660fd4 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:09.498081 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-edbdc9ca-28c4-441d-834c-b8d7cc660fd4 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:09.498899 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-edbdc9ca-28c4-441d-834c-b8d7cc660fd4 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:09.499401 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-edbdc9ca-28c4-441d-834c-b8d7cc660fd4 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:09.642033 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-edbdc9ca-28c4-441d-834c-b8d7cc660fd4 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:09.649510 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-edbdc9ca-28c4-441d-834c-b8d7cc660fd4 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1" status: 200 len: 1319 microversion: 2.1 time: 0.163728 Dec 27 14:25:09.650088 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 373/770] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:09 2021] GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:25:09.952576 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-41078e7e-47d2-48ca-a30d-a2d5139934ba tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:09.953333 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-41078e7e-47d2-48ca-a30d-a2d5139934ba tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] [instance: 8520422d-f3a9-443c-9e9a-12fb03ef1bcc] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:09.960217 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-41078e7e-47d2-48ca-a30d-a2d5139934ba tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:09.960667 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-41078e7e-47d2-48ca-a30d-a2d5139934ba tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:09.961440 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-41078e7e-47d2-48ca-a30d-a2d5139934ba tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:09.962094 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-41078e7e-47d2-48ca-a30d-a2d5139934ba tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:09.975585 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-41078e7e-47d2-48ca-a30d-a2d5139934ba tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] HTTP exception thrown: Instance 8520422d-f3a9-443c-9e9a-12fb03ef1bcc could not be found. Dec 27 14:25:09.976208 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-41078e7e-47d2-48ca-a30d-a2d5139934ba tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] Returning 404 to user: Instance 8520422d-f3a9-443c-9e9a-12fb03ef1bcc could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:25:09.977009 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-41078e7e-47d2-48ca-a30d-a2d5139934ba tempest-ServerRescueNegativeTestJSON-120080163 tempest-ServerRescueNegativeTestJSON-120080163-project] 10.222.0.37 "GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc" status: 404 len: 111 microversion: 2.1 time: 0.028553 Dec 27 14:25:09.978036 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 398/771] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:09 2021] GET /compute/v2.1/servers/8520422d-f3a9-443c-9e9a-12fb03ef1bcc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:25:10.285429 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-762b7418-5900-4d25-a65c-38c9cfa06114 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:10.286549 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-762b7418-5900-4d25-a65c-38c9cfa06114 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:10.293457 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-762b7418-5900-4d25-a65c-38c9cfa06114 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:10.294165 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-762b7418-5900-4d25-a65c-38c9cfa06114 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:10.295918 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-762b7418-5900-4d25-a65c-38c9cfa06114 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:10.295918 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-762b7418-5900-4d25-a65c-38c9cfa06114 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:10.309177 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-2158e63e-11fd-4ab4-8883-a3644232a7ed req-bacc6444-9a28-4ff1-a69d-c6306c69102c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6b99852-a0cc-44d9-8da9-2fbdd2d580f1", "name": "network-vif-plugged", "status": "completed", "tag": "2788dd5b-31c5-42aa-ad4a-fbce4daa2d80"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:10.313249 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:25:10.313249 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:25:10.323825 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-2158e63e-11fd-4ab4-8883-a3644232a7ed req-bacc6444-9a28-4ff1-a69d-c6306c69102c service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:10.324397 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-2158e63e-11fd-4ab4-8883-a3644232a7ed req-bacc6444-9a28-4ff1-a69d-c6306c69102c service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:10.336814 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-2158e63e-11fd-4ab4-8883-a3644232a7ed req-bacc6444-9a28-4ff1-a69d-c6306c69102c service nova] Creating event network-vif-plugged:2788dd5b-31c5-42aa-ad4a-fbce4daa2d80 for instance c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 on hv-cinder-82301 Dec 27 14:25:10.342031 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-2158e63e-11fd-4ab4-8883-a3644232a7ed req-bacc6444-9a28-4ff1-a69d-c6306c69102c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038133 Dec 27 14:25:10.342857 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 399/772] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:25:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:25:10.389013 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-762b7418-5900-4d25-a65c-38c9cfa06114 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.107251 Dec 27 14:25:10.389985 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 374/773] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:10 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:10.668065 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5e10e19a-602a-44a8-a606-c3b78f2a53fe tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:10.668765 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5e10e19a-602a-44a8-a606-c3b78f2a53fe tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:10.674757 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5e10e19a-602a-44a8-a606-c3b78f2a53fe tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:10.675210 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5e10e19a-602a-44a8-a606-c3b78f2a53fe tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:10.676206 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5e10e19a-602a-44a8-a606-c3b78f2a53fe tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:10.676642 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5e10e19a-602a-44a8-a606-c3b78f2a53fe tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:10.886895 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5e10e19a-602a-44a8-a606-c3b78f2a53fe tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:10.894726 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5e10e19a-602a-44a8-a606-c3b78f2a53fe tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1" status: 200 len: 1319 microversion: 2.1 time: 0.231977 Dec 27 14:25:10.904897 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 400/774] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:10 2021] GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:25:11.402128 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c76ca633-e5d8-4684-8554-d5269be18836 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:11.403072 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c76ca633-e5d8-4684-8554-d5269be18836 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:11.410829 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c76ca633-e5d8-4684-8554-d5269be18836 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:11.411281 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c76ca633-e5d8-4684-8554-d5269be18836 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:11.412163 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c76ca633-e5d8-4684-8554-d5269be18836 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:11.412609 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c76ca633-e5d8-4684-8554-d5269be18836 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:11.531314 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c76ca633-e5d8-4684-8554-d5269be18836 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.133004 Dec 27 14:25:11.531989 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 375/775] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:11 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:11.913313 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7f73225c-4fb7-4493-9b5c-195faa8c8383 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:11.913313 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7f73225c-4fb7-4493-9b5c-195faa8c8383 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:11.920247 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7f73225c-4fb7-4493-9b5c-195faa8c8383 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:11.920814 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7f73225c-4fb7-4493-9b5c-195faa8c8383 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:11.921769 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7f73225c-4fb7-4493-9b5c-195faa8c8383 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:11.922387 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7f73225c-4fb7-4493-9b5c-195faa8c8383 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:12.166871 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-7f73225c-4fb7-4493-9b5c-195faa8c8383 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:12.176447 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7f73225c-4fb7-4493-9b5c-195faa8c8383 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1" status: 200 len: 1319 microversion: 2.1 time: 0.267689 Dec 27 14:25:12.177557 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 401/776] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:11 2021] GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:25:12.542911 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d81e7ed5-c3ee-4e9c-8e09-63335bab0e7b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:12.544739 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d81e7ed5-c3ee-4e9c-8e09-63335bab0e7b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:12.551368 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d81e7ed5-c3ee-4e9c-8e09-63335bab0e7b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:12.551821 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d81e7ed5-c3ee-4e9c-8e09-63335bab0e7b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:12.552648 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d81e7ed5-c3ee-4e9c-8e09-63335bab0e7b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:12.553281 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d81e7ed5-c3ee-4e9c-8e09-63335bab0e7b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:12.633247 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d81e7ed5-c3ee-4e9c-8e09-63335bab0e7b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.093797 Dec 27 14:25:12.635151 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 376/777] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:12 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:13.193231 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a97cde35-ceb5-45a4-94f0-1195cf7bec61 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:13.193845 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a97cde35-ceb5-45a4-94f0-1195cf7bec61 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:13.201575 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a97cde35-ceb5-45a4-94f0-1195cf7bec61 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:13.201969 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a97cde35-ceb5-45a4-94f0-1195cf7bec61 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:13.202763 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a97cde35-ceb5-45a4-94f0-1195cf7bec61 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:13.203204 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a97cde35-ceb5-45a4-94f0-1195cf7bec61 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:13.508259 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a97cde35-ceb5-45a4-94f0-1195cf7bec61 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:13.526782 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a97cde35-ceb5-45a4-94f0-1195cf7bec61 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1" status: 200 len: 1509 microversion: 2.1 time: 0.336954 Dec 27 14:25:13.527716 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 402/778] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:13 2021] GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 => generated 1509 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:25:13.545814 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d9483d1f-7af9-4019-804d-b732e1e22915 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b674150d-61f5-411c-85a6-09ebeb5039a7", "device": "/dev/sdb"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:13.547022 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d9483d1f-7af9-4019-804d-b732e1e22915 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:13.554543 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d9483d1f-7af9-4019-804d-b732e1e22915 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:13.555310 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d9483d1f-7af9-4019-804d-b732e1e22915 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:13.556849 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d9483d1f-7af9-4019-804d-b732e1e22915 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:13.557442 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d9483d1f-7af9-4019-804d-b732e1e22915 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:13.654806 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f8fb536f-684d-4f6b-beba-4af773aad11d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:13.656501 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f8fb536f-684d-4f6b-beba-4af773aad11d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:13.663325 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f8fb536f-684d-4f6b-beba-4af773aad11d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:13.663937 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f8fb536f-684d-4f6b-beba-4af773aad11d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:13.665819 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f8fb536f-684d-4f6b-beba-4af773aad11d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:13.666618 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f8fb536f-684d-4f6b-beba-4af773aad11d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:13.740077 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f8fb536f-684d-4f6b-beba-4af773aad11d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.097049 Dec 27 14:25:13.740798 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 403/779] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:13 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:25:13.859680 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d9483d1f-7af9-4019-804d-b732e1e22915 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "POST /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319654 Dec 27 14:25:13.860740 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 377/780] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Dec 27 14:25:13 2021] POST /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:25:14.752528 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-310cf746-c3df-4f3f-95c5-8cddbb6c2093 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:14.754125 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-310cf746-c3df-4f3f-95c5-8cddbb6c2093 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:14.761369 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-310cf746-c3df-4f3f-95c5-8cddbb6c2093 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:14.761816 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-310cf746-c3df-4f3f-95c5-8cddbb6c2093 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:14.762773 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-310cf746-c3df-4f3f-95c5-8cddbb6c2093 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:14.763366 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-310cf746-c3df-4f3f-95c5-8cddbb6c2093 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:14.829431 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-310cf746-c3df-4f3f-95c5-8cddbb6c2093 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.080596 Dec 27 14:25:14.831073 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 404/781] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:14 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:15.842405 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d8eb84e5-5f06-4bc6-86ba-9bc0085a9ece tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:15.844618 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d8eb84e5-5f06-4bc6-86ba-9bc0085a9ece tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:15.855490 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d8eb84e5-5f06-4bc6-86ba-9bc0085a9ece tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:15.855974 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d8eb84e5-5f06-4bc6-86ba-9bc0085a9ece tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:15.856770 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d8eb84e5-5f06-4bc6-86ba-9bc0085a9ece tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:15.857201 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d8eb84e5-5f06-4bc6-86ba-9bc0085a9ece tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:15.934690 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d8eb84e5-5f06-4bc6-86ba-9bc0085a9ece tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.096637 Dec 27 14:25:15.935357 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 378/782] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:15 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:25:16.947572 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-784a5681-20d8-4b98-b80a-74a86eab222f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:16.948735 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-784a5681-20d8-4b98-b80a-74a86eab222f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:16.956055 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-784a5681-20d8-4b98-b80a-74a86eab222f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:16.956584 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-784a5681-20d8-4b98-b80a-74a86eab222f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:16.957775 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-784a5681-20d8-4b98-b80a-74a86eab222f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:16.957870 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-784a5681-20d8-4b98-b80a-74a86eab222f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:20.318536 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-784a5681-20d8-4b98-b80a-74a86eab222f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 3.375542 Dec 27 14:25:20.319554 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 405/783] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:16 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 3377 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:21.331021 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-66761401-e63b-4c35-b343-9d0e71c5b9b6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:21.332176 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-66761401-e63b-4c35-b343-9d0e71c5b9b6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:21.339722 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66761401-e63b-4c35-b343-9d0e71c5b9b6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:21.340274 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66761401-e63b-4c35-b343-9d0e71c5b9b6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:21.341064 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66761401-e63b-4c35-b343-9d0e71c5b9b6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:21.341503 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66761401-e63b-4c35-b343-9d0e71c5b9b6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:21.409514 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-66761401-e63b-4c35-b343-9d0e71c5b9b6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.082387 Dec 27 14:25:21.410446 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 379/784] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:21 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:22.423781 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-cff3bce4-30db-4dae-b91c-0718773156db tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:22.424740 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-cff3bce4-30db-4dae-b91c-0718773156db tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:22.432493 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cff3bce4-30db-4dae-b91c-0718773156db tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:22.433075 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cff3bce4-30db-4dae-b91c-0718773156db tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:22.434145 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cff3bce4-30db-4dae-b91c-0718773156db tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:22.434303 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cff3bce4-30db-4dae-b91c-0718773156db tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:22.513316 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-cff3bce4-30db-4dae-b91c-0718773156db tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.094443 Dec 27 14:25:22.513994 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 406/785] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:22 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:23.538107 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3d6c97ed-da19-4810-bd5b-7e0041ad74c3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:23.539188 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3d6c97ed-da19-4810-bd5b-7e0041ad74c3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:23.546132 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d6c97ed-da19-4810-bd5b-7e0041ad74c3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:23.551918 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d6c97ed-da19-4810-bd5b-7e0041ad74c3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:23.552938 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d6c97ed-da19-4810-bd5b-7e0041ad74c3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:23.553605 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3d6c97ed-da19-4810-bd5b-7e0041ad74c3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:25.424723 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3d6c97ed-da19-4810-bd5b-7e0041ad74c3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 1.902340 Dec 27 14:25:25.425724 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 380/786] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:23 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:26.436763 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6c612af1-74a5-4fb8-86f9-21a3491dac42 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:26.437763 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6c612af1-74a5-4fb8-86f9-21a3491dac42 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:26.444630 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c612af1-74a5-4fb8-86f9-21a3491dac42 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:26.445083 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c612af1-74a5-4fb8-86f9-21a3491dac42 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:26.445867 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c612af1-74a5-4fb8-86f9-21a3491dac42 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:26.446299 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c612af1-74a5-4fb8-86f9-21a3491dac42 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:27.106103 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6c612af1-74a5-4fb8-86f9-21a3491dac42 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.673209 Dec 27 14:25:27.107284 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 407/787] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:26 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:28.118374 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6efb137f-fc4f-489c-b4b8-bd79d08937df tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:28.120070 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6efb137f-fc4f-489c-b4b8-bd79d08937df tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:28.127527 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6efb137f-fc4f-489c-b4b8-bd79d08937df tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:28.128004 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6efb137f-fc4f-489c-b4b8-bd79d08937df tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:28.128800 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6efb137f-fc4f-489c-b4b8-bd79d08937df tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:28.129242 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6efb137f-fc4f-489c-b4b8-bd79d08937df tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:28.210956 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6efb137f-fc4f-489c-b4b8-bd79d08937df tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.096468 Dec 27 14:25:28.211586 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 381/788] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:28 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:29.223581 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-093290e7-b37d-46dc-a0b7-bd2e58fe0484 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:29.224611 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-093290e7-b37d-46dc-a0b7-bd2e58fe0484 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:29.232637 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-093290e7-b37d-46dc-a0b7-bd2e58fe0484 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:29.233087 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-093290e7-b37d-46dc-a0b7-bd2e58fe0484 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:29.233857 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-093290e7-b37d-46dc-a0b7-bd2e58fe0484 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:29.234290 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-093290e7-b37d-46dc-a0b7-bd2e58fe0484 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:29.298343 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-093290e7-b37d-46dc-a0b7-bd2e58fe0484 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.078590 Dec 27 14:25:29.299039 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 408/789] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:29 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:30.310933 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5ae8e19b-63f0-47f1-bf3a-ee8b4e9f0d1a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:30.311968 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5ae8e19b-63f0-47f1-bf3a-ee8b4e9f0d1a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:30.320291 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5ae8e19b-63f0-47f1-bf3a-ee8b4e9f0d1a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:30.320736 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5ae8e19b-63f0-47f1-bf3a-ee8b4e9f0d1a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:30.321544 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5ae8e19b-63f0-47f1-bf3a-ee8b4e9f0d1a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:30.321976 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5ae8e19b-63f0-47f1-bf3a-ee8b4e9f0d1a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:32.049557 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5ae8e19b-63f0-47f1-bf3a-ee8b4e9f0d1a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 1.743019 Dec 27 14:25:32.050193 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 382/790] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:30 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 1745 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:33.061753 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-349834a9-8ca4-462d-a51f-8723d3fdccbc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:33.062925 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-349834a9-8ca4-462d-a51f-8723d3fdccbc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:33.069875 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-349834a9-8ca4-462d-a51f-8723d3fdccbc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:33.070323 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-349834a9-8ca4-462d-a51f-8723d3fdccbc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:33.071093 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-349834a9-8ca4-462d-a51f-8723d3fdccbc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:33.072112 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-349834a9-8ca4-462d-a51f-8723d3fdccbc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:33.527548 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-349834a9-8ca4-462d-a51f-8723d3fdccbc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.469874 Dec 27 14:25:33.529020 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 409/791] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:33 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:25:34.539392 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3e12ed59-d362-4971-bbb1-76f6d7815124 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:34.541097 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3e12ed59-d362-4971-bbb1-76f6d7815124 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:34.548555 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e12ed59-d362-4971-bbb1-76f6d7815124 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:34.548998 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e12ed59-d362-4971-bbb1-76f6d7815124 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:34.549774 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e12ed59-d362-4971-bbb1-76f6d7815124 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:34.550205 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e12ed59-d362-4971-bbb1-76f6d7815124 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:34.611559 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3e12ed59-d362-4971-bbb1-76f6d7815124 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.076034 Dec 27 14:25:34.612211 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 383/792] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:34 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:35.629045 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-292c0e7c-473b-491c-8e91-cc740fb133b4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:35.629045 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-292c0e7c-473b-491c-8e91-cc740fb133b4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:35.634906 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-292c0e7c-473b-491c-8e91-cc740fb133b4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:35.635391 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-292c0e7c-473b-491c-8e91-cc740fb133b4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:35.636209 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-292c0e7c-473b-491c-8e91-cc740fb133b4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:35.637049 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-292c0e7c-473b-491c-8e91-cc740fb133b4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:35.705652 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-292c0e7c-473b-491c-8e91-cc740fb133b4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.085390 Dec 27 14:25:35.706545 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 410/793] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:35 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:36.718623 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d5d52bd2-50e7-442f-aac9-e73b437f5cbf tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:36.719747 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d5d52bd2-50e7-442f-aac9-e73b437f5cbf tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:36.727107 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5d52bd2-50e7-442f-aac9-e73b437f5cbf tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:36.727650 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5d52bd2-50e7-442f-aac9-e73b437f5cbf tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:36.728965 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5d52bd2-50e7-442f-aac9-e73b437f5cbf tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:36.729405 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5d52bd2-50e7-442f-aac9-e73b437f5cbf tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:36.793588 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d5d52bd2-50e7-442f-aac9-e73b437f5cbf tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.078973 Dec 27 14:25:36.797558 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 384/794] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:36 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:37.805811 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-592dfdb9-26bd-414d-bec9-826cb74e18c5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:37.807071 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-592dfdb9-26bd-414d-bec9-826cb74e18c5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:37.814092 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-592dfdb9-26bd-414d-bec9-826cb74e18c5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:37.814446 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-592dfdb9-26bd-414d-bec9-826cb74e18c5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:37.815233 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-592dfdb9-26bd-414d-bec9-826cb74e18c5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:37.815783 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-592dfdb9-26bd-414d-bec9-826cb74e18c5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:37.886686 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-592dfdb9-26bd-414d-bec9-826cb74e18c5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.084835 Dec 27 14:25:37.888743 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 411/795] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:37 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:38.289323 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3259414d-65de-4517-b570-9a277163924b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:38.291361 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3259414d-65de-4517-b570-9a277163924b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:38.298841 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3259414d-65de-4517-b570-9a277163924b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:38.299334 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3259414d-65de-4517-b570-9a277163924b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:38.300152 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3259414d-65de-4517-b570-9a277163924b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:38.300584 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3259414d-65de-4517-b570-9a277163924b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:38.388705 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-3259414d-65de-4517-b570-9a277163924b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lazy-loading 'services' on Instance uuid c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:25:38.462063 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3259414d-65de-4517-b570-9a277163924b tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "DELETE /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1/os-volume_attachments/b674150d-61f5-411c-85a6-09ebeb5039a7" status: 202 len: 0 microversion: 2.1 time: 0.177484 Dec 27 14:25:38.466110 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 385/796] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Dec 27 14:25:38 2021] DELETE /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1/os-volume_attachments/b674150d-61f5-411c-85a6-09ebeb5039a7 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:38.899621 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-efd45abf-f377-4c43-bd31-48bf8a30d9cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:38.900828 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-efd45abf-f377-4c43-bd31-48bf8a30d9cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:38.908080 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-efd45abf-f377-4c43-bd31-48bf8a30d9cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:38.908537 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-efd45abf-f377-4c43-bd31-48bf8a30d9cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:38.909324 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-efd45abf-f377-4c43-bd31-48bf8a30d9cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:38.909828 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-efd45abf-f377-4c43-bd31-48bf8a30d9cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:38.992106 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-efd45abf-f377-4c43-bd31-48bf8a30d9cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.096331 Dec 27 14:25:38.992641 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 412/797] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:38 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:39.582161 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-292d316b-181e-497a-a6f2-d151169ad49e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:39.582913 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-292d316b-181e-497a-a6f2-d151169ad49e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:39.589988 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-292d316b-181e-497a-a6f2-d151169ad49e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:39.590481 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-292d316b-181e-497a-a6f2-d151169ad49e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:39.591322 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-292d316b-181e-497a-a6f2-d151169ad49e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:39.591821 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-292d316b-181e-497a-a6f2-d151169ad49e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:39.621755 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-292d316b-181e-497a-a6f2-d151169ad49e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 27 14:25:39.707143 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-292d316b-181e-497a-a6f2-d151169ad49e tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "DELETE /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1" status: 204 len: 0 microversion: 2.1 time: 0.128994 Dec 27 14:25:39.707738 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 386/798] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Dec 27 14:25:39 2021] DELETE /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 27 14:25:39.717929 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a6f8fa0c-5735-494e-aa57-2558a88b0f78 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:39.718385 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a6f8fa0c-5735-494e-aa57-2558a88b0f78 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:39.725586 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a6f8fa0c-5735-494e-aa57-2558a88b0f78 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:39.726141 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a6f8fa0c-5735-494e-aa57-2558a88b0f78 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:39.727489 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a6f8fa0c-5735-494e-aa57-2558a88b0f78 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:39.728622 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a6f8fa0c-5735-494e-aa57-2558a88b0f78 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:39.862768 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a6f8fa0c-5735-494e-aa57-2558a88b0f78 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:39.870184 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a6f8fa0c-5735-494e-aa57-2558a88b0f78 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1" status: 200 len: 1515 microversion: 2.1 time: 0.157276 Dec 27 14:25:39.870758 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 413/799] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:39 2021] GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:25:40.005258 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b1cd70b7-9d80-4195-b9a6-a47e494bbaec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:40.006374 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b1cd70b7-9d80-4195-b9a6-a47e494bbaec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:40.013678 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1cd70b7-9d80-4195-b9a6-a47e494bbaec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:40.013981 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1cd70b7-9d80-4195-b9a6-a47e494bbaec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:40.014773 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1cd70b7-9d80-4195-b9a6-a47e494bbaec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:40.015211 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1cd70b7-9d80-4195-b9a6-a47e494bbaec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:40.093177 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b1cd70b7-9d80-4195-b9a6-a47e494bbaec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.092314 Dec 27 14:25:40.097146 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 387/800] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:39 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:40.887488 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c34f78ab-0d83-4b23-bde9-85859d6d1d3c tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:40.888188 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c34f78ab-0d83-4b23-bde9-85859d6d1d3c tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:40.894061 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c34f78ab-0d83-4b23-bde9-85859d6d1d3c tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:40.894511 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c34f78ab-0d83-4b23-bde9-85859d6d1d3c tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:40.895284 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c34f78ab-0d83-4b23-bde9-85859d6d1d3c tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:40.895717 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c34f78ab-0d83-4b23-bde9-85859d6d1d3c tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:41.029832 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c34f78ab-0d83-4b23-bde9-85859d6d1d3c tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:41.040660 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c34f78ab-0d83-4b23-bde9-85859d6d1d3c tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1" status: 200 len: 1515 microversion: 2.1 time: 0.156637 Dec 27 14:25:41.041245 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 414/801] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:40 2021] GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:25:41.106053 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b0035885-ff90-433a-8466-7fc383f71f77 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:41.107049 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b0035885-ff90-433a-8466-7fc383f71f77 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:41.113904 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0035885-ff90-433a-8466-7fc383f71f77 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:41.114345 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0035885-ff90-433a-8466-7fc383f71f77 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:41.115117 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0035885-ff90-433a-8466-7fc383f71f77 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:41.115546 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0035885-ff90-433a-8466-7fc383f71f77 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:41.194532 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b0035885-ff90-433a-8466-7fc383f71f77 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.093130 Dec 27 14:25:41.195344 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 388/802] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:41 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:42.060040 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f60d89c0-c692-4bcd-854a-97bb20f9e890 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:42.060657 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f60d89c0-c692-4bcd-854a-97bb20f9e890 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:42.073448 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f60d89c0-c692-4bcd-854a-97bb20f9e890 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:42.074008 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f60d89c0-c692-4bcd-854a-97bb20f9e890 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:42.075027 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f60d89c0-c692-4bcd-854a-97bb20f9e890 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:42.075536 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f60d89c0-c692-4bcd-854a-97bb20f9e890 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:42.207625 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-26effd61-ab43-45c6-aebc-0b911bea24a0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:42.209230 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-26effd61-ab43-45c6-aebc-0b911bea24a0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:42.214829 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f60d89c0-c692-4bcd-854a-97bb20f9e890 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:42.217344 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-26effd61-ab43-45c6-aebc-0b911bea24a0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:42.219308 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-26effd61-ab43-45c6-aebc-0b911bea24a0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:42.220716 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-26effd61-ab43-45c6-aebc-0b911bea24a0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:42.221427 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-26effd61-ab43-45c6-aebc-0b911bea24a0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:42.222909 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f60d89c0-c692-4bcd-854a-97bb20f9e890 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1" status: 200 len: 1515 microversion: 2.1 time: 0.169073 Dec 27 14:25:42.223509 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 415/803] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:42 2021] GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:25:42.310610 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-26effd61-ab43-45c6-aebc-0b911bea24a0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.107752 Dec 27 14:25:42.311690 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 389/804] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:42 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:25:42.849453 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-6f5634a4-df42-425b-ab86-d31f2856f204 req-05bd4da3-7314-42a4-bbe8-8e5946b20574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6b99852-a0cc-44d9-8da9-2fbdd2d580f1", "name": "network-vif-deleted", "tag": "2788dd5b-31c5-42aa-ad4a-fbce4daa2d80"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:42.851222 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:25:42.851222 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:25:42.859071 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-6f5634a4-df42-425b-ab86-d31f2856f204 req-05bd4da3-7314-42a4-bbe8-8e5946b20574 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:42.859438 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-6f5634a4-df42-425b-ab86-d31f2856f204 req-05bd4da3-7314-42a4-bbe8-8e5946b20574 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:42.870950 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-6f5634a4-df42-425b-ab86-d31f2856f204 req-05bd4da3-7314-42a4-bbe8-8e5946b20574 service nova] Creating event network-vif-deleted:2788dd5b-31c5-42aa-ad4a-fbce4daa2d80 for instance c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 on hv-cinder-82301 Dec 27 14:25:42.876058 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-6f5634a4-df42-425b-ab86-d31f2856f204 req-05bd4da3-7314-42a4-bbe8-8e5946b20574 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030512 Dec 27 14:25:42.876650 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 416/805] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:25:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:25:43.241562 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7eaa756f-9894-4a60-b753-b15c66d02a47 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:43.243011 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7eaa756f-9894-4a60-b753-b15c66d02a47 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:43.250637 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7eaa756f-9894-4a60-b753-b15c66d02a47 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:43.251349 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7eaa756f-9894-4a60-b753-b15c66d02a47 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:43.252178 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7eaa756f-9894-4a60-b753-b15c66d02a47 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:43.252613 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7eaa756f-9894-4a60-b753-b15c66d02a47 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:43.292357 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7eaa756f-9894-4a60-b753-b15c66d02a47 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:43.293023 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7eaa756f-9894-4a60-b753-b15c66d02a47 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:43.293667 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-7eaa756f-9894-4a60-b753-b15c66d02a47 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lazy-loading 'fault' on Instance uuid c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:25:43.323205 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2fb63efb-b340-4b1e-93bc-d4eb64d3988a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:43.324816 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2fb63efb-b340-4b1e-93bc-d4eb64d3988a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:43.334012 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2fb63efb-b340-4b1e-93bc-d4eb64d3988a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:43.334501 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2fb63efb-b340-4b1e-93bc-d4eb64d3988a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:43.335313 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2fb63efb-b340-4b1e-93bc-d4eb64d3988a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:43.335799 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2fb63efb-b340-4b1e-93bc-d4eb64d3988a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:43.373005 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7eaa756f-9894-4a60-b753-b15c66d02a47 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeb11dc4bf4c487a89a68500478f9e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6945d0284cf64136bf191e4e1ae16b37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:25:43.379607 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7eaa756f-9894-4a60-b753-b15c66d02a47 tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1" status: 200 len: 1309 microversion: 2.1 time: 0.142507 Dec 27 14:25:43.380219 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 390/806] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:43 2021] GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 => generated 1309 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:25:43.411003 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2fb63efb-b340-4b1e-93bc-d4eb64d3988a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.091984 Dec 27 14:25:43.415662 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 417/807] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:43 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:44.401840 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0f6d2216-636e-4bab-9552-bb1160efa48d tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:25:44.402359 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0f6d2216-636e-4bab-9552-bb1160efa48d tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] [instance: c6b99852-a0cc-44d9-8da9-2fbdd2d580f1] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:44.408962 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0f6d2216-636e-4bab-9552-bb1160efa48d tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:44.409415 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0f6d2216-636e-4bab-9552-bb1160efa48d tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:44.410203 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0f6d2216-636e-4bab-9552-bb1160efa48d tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:44.410643 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0f6d2216-636e-4bab-9552-bb1160efa48d tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:44.422962 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ce02b942-2cca-4087-aa3c-f87ec987146d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:44.424028 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ce02b942-2cca-4087-aa3c-f87ec987146d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:44.425224 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-0f6d2216-636e-4bab-9552-bb1160efa48d tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] HTTP exception thrown: Instance c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 could not be found. Dec 27 14:25:44.425984 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0f6d2216-636e-4bab-9552-bb1160efa48d tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] Returning 404 to user: Instance c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:25:44.426817 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0f6d2216-636e-4bab-9552-bb1160efa48d tempest-VolumesSnapshotTestJSON-1707667636 tempest-VolumesSnapshotTestJSON-1707667636-project] 10.222.0.37 "GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1" status: 404 len: 111 microversion: 2.1 time: 0.028806 Dec 27 14:25:44.428480 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 391/808] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:25:44 2021] GET /compute/v2.1/servers/c6b99852-a0cc-44d9-8da9-2fbdd2d580f1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:25:44.433914 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce02b942-2cca-4087-aa3c-f87ec987146d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:44.434365 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce02b942-2cca-4087-aa3c-f87ec987146d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:44.435156 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce02b942-2cca-4087-aa3c-f87ec987146d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:44.435591 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce02b942-2cca-4087-aa3c-f87ec987146d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:44.498293 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ce02b942-2cca-4087-aa3c-f87ec987146d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.079164 Dec 27 14:25:44.498958 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 418/809] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:44 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:25:45.509112 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b1a0db76-b3b0-4a1f-9c32-a7f619359dba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:45.510020 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b1a0db76-b3b0-4a1f-9c32-a7f619359dba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:45.516273 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1a0db76-b3b0-4a1f-9c32-a7f619359dba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:45.516724 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1a0db76-b3b0-4a1f-9c32-a7f619359dba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:45.517488 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1a0db76-b3b0-4a1f-9c32-a7f619359dba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:45.517921 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b1a0db76-b3b0-4a1f-9c32-a7f619359dba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:45.588324 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b1a0db76-b3b0-4a1f-9c32-a7f619359dba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.082698 Dec 27 14:25:45.588976 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 392/810] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:45 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:46.600860 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-462ddda6-5183-42be-8d08-c3e91c77c0fa tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:46.601782 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-462ddda6-5183-42be-8d08-c3e91c77c0fa tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:46.609048 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-462ddda6-5183-42be-8d08-c3e91c77c0fa tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:46.609505 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-462ddda6-5183-42be-8d08-c3e91c77c0fa tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:46.610299 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-462ddda6-5183-42be-8d08-c3e91c77c0fa tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:46.610736 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-462ddda6-5183-42be-8d08-c3e91c77c0fa tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:47.108131 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-462ddda6-5183-42be-8d08-c3e91c77c0fa tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.511290 Dec 27 14:25:47.112033 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 419/811] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:46 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:48.121046 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5f40d35d-d945-45a0-b649-1f28f4ed2080 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:48.122079 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5f40d35d-d945-45a0-b649-1f28f4ed2080 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:48.129077 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f40d35d-d945-45a0-b649-1f28f4ed2080 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:48.129529 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f40d35d-d945-45a0-b649-1f28f4ed2080 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:48.130317 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f40d35d-d945-45a0-b649-1f28f4ed2080 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:48.130755 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f40d35d-d945-45a0-b649-1f28f4ed2080 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:51.812434 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5f40d35d-d945-45a0-b649-1f28f4ed2080 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 3.694647 Dec 27 14:25:51.812434 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 393/812] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:48 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 3697 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:52.824352 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5a61fe2d-3546-4656-bead-675663a3ce13 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:52.825369 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5a61fe2d-3546-4656-bead-675663a3ce13 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:52.832426 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5a61fe2d-3546-4656-bead-675663a3ce13 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:52.832873 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5a61fe2d-3546-4656-bead-675663a3ce13 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:52.833788 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5a61fe2d-3546-4656-bead-675663a3ce13 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:52.834226 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5a61fe2d-3546-4656-bead-675663a3ce13 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:52.896632 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5a61fe2d-3546-4656-bead-675663a3ce13 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.076743 Dec 27 14:25:52.897284 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 420/813] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:52 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:53.909481 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2f1a91d1-c6be-4c99-aba9-b2e62d7614e8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:53.910462 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2f1a91d1-c6be-4c99-aba9-b2e62d7614e8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:53.919114 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f1a91d1-c6be-4c99-aba9-b2e62d7614e8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:53.919567 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f1a91d1-c6be-4c99-aba9-b2e62d7614e8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:53.920385 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f1a91d1-c6be-4c99-aba9-b2e62d7614e8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:53.920821 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2f1a91d1-c6be-4c99-aba9-b2e62d7614e8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:53.984097 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2f1a91d1-c6be-4c99-aba9-b2e62d7614e8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.078734 Dec 27 14:25:53.984837 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 394/814] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:53 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:54.997157 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-09723517-0e98-41af-a40e-2ce52165a97b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:54.998180 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-09723517-0e98-41af-a40e-2ce52165a97b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:55.005083 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-09723517-0e98-41af-a40e-2ce52165a97b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:55.005538 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-09723517-0e98-41af-a40e-2ce52165a97b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:55.006318 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-09723517-0e98-41af-a40e-2ce52165a97b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:55.006750 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-09723517-0e98-41af-a40e-2ce52165a97b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:55.091349 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-09723517-0e98-41af-a40e-2ce52165a97b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.098366 Dec 27 14:25:55.092022 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 421/815] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:54 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:56.104870 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-aae899e5-5cdd-4cdf-94a6-d8de58b43c5d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:56.105935 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-aae899e5-5cdd-4cdf-94a6-d8de58b43c5d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:56.112997 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aae899e5-5cdd-4cdf-94a6-d8de58b43c5d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:56.113461 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aae899e5-5cdd-4cdf-94a6-d8de58b43c5d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:56.114451 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aae899e5-5cdd-4cdf-94a6-d8de58b43c5d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:56.114888 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aae899e5-5cdd-4cdf-94a6-d8de58b43c5d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:56.191529 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-aae899e5-5cdd-4cdf-94a6-d8de58b43c5d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.092132 Dec 27 14:25:56.192237 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 395/816] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:56 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:57.005972 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 27 14:25:57.006192 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: Mon Dec 27 14:25:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 27 14:25:57.203476 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-aea1f1db-b4f4-4ab0-9217-990c6bf7ff43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:57.204639 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-aea1f1db-b4f4-4ab0-9217-990c6bf7ff43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:57.212278 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aea1f1db-b4f4-4ab0-9217-990c6bf7ff43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:57.212734 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aea1f1db-b4f4-4ab0-9217-990c6bf7ff43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:57.213532 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aea1f1db-b4f4-4ab0-9217-990c6bf7ff43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:57.213995 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aea1f1db-b4f4-4ab0-9217-990c6bf7ff43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:57.281963 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-aea1f1db-b4f4-4ab0-9217-990c6bf7ff43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.082315 Dec 27 14:25:57.282824 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 422/817] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:57 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:25:58.294515 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8c256bb7-763b-4394-9e1a-7a529569899f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:25:58.295552 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8c256bb7-763b-4394-9e1a-7a529569899f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:25:58.303040 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8c256bb7-763b-4394-9e1a-7a529569899f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:58.303488 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8c256bb7-763b-4394-9e1a-7a529569899f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:25:58.304301 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8c256bb7-763b-4394-9e1a-7a529569899f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:25:58.305267 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8c256bb7-763b-4394-9e1a-7a529569899f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:02.556684 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8c256bb7-763b-4394-9e1a-7a529569899f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 4.266012 Dec 27 14:26:02.558260 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 396/818] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:25:58 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 4268 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:26:03.569360 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-adf36e01-09a7-440a-b3b5-7ff482443b76 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:26:03.570416 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-adf36e01-09a7-440a-b3b5-7ff482443b76 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:03.577351 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-adf36e01-09a7-440a-b3b5-7ff482443b76 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:03.577804 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-adf36e01-09a7-440a-b3b5-7ff482443b76 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:03.578698 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-adf36e01-09a7-440a-b3b5-7ff482443b76 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:03.579180 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-adf36e01-09a7-440a-b3b5-7ff482443b76 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:03.654029 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-adf36e01-09a7-440a-b3b5-7ff482443b76 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.088626 Dec 27 14:26:03.654677 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 423/819] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:26:03 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:26:04.667483 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0afe0ded-2b3c-4fe2-a468-510ba9d91040 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:26:04.668560 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0afe0ded-2b3c-4fe2-a468-510ba9d91040 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:04.675943 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0afe0ded-2b3c-4fe2-a468-510ba9d91040 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:04.676404 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0afe0ded-2b3c-4fe2-a468-510ba9d91040 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:04.677191 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0afe0ded-2b3c-4fe2-a468-510ba9d91040 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:04.677630 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0afe0ded-2b3c-4fe2-a468-510ba9d91040 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:04.740080 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0afe0ded-2b3c-4fe2-a468-510ba9d91040 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.077284 Dec 27 14:26:04.740954 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 397/820] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:26:04 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:26:05.755078 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fad7b06c-3915-42c8-8e6e-58f7a0dfe0ad tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:26:05.756570 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fad7b06c-3915-42c8-8e6e-58f7a0dfe0ad tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:05.765500 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fad7b06c-3915-42c8-8e6e-58f7a0dfe0ad tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:05.765949 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fad7b06c-3915-42c8-8e6e-58f7a0dfe0ad tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:05.766717 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fad7b06c-3915-42c8-8e6e-58f7a0dfe0ad tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:05.767146 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fad7b06c-3915-42c8-8e6e-58f7a0dfe0ad tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:08.871902 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fad7b06c-3915-42c8-8e6e-58f7a0dfe0ad tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 3.122272 Dec 27 14:26:08.872568 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 424/821] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:26:05 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 3124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:26:09.883795 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0c5b1817-27cb-4a6a-b954-8954434ff11a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:26:09.884841 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0c5b1817-27cb-4a6a-b954-8954434ff11a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:09.891761 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0c5b1817-27cb-4a6a-b954-8954434ff11a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:09.892242 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0c5b1817-27cb-4a6a-b954-8954434ff11a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:09.893036 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0c5b1817-27cb-4a6a-b954-8954434ff11a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:09.893480 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0c5b1817-27cb-4a6a-b954-8954434ff11a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:09.979163 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0c5b1817-27cb-4a6a-b954-8954434ff11a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.099473 Dec 27 14:26:09.979740 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 398/822] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:26:09 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:26:10.991268 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-34cdb77e-08ec-4b47-b2de-8bd28c36fecd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:26:10.992365 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-34cdb77e-08ec-4b47-b2de-8bd28c36fecd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:11.000135 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-34cdb77e-08ec-4b47-b2de-8bd28c36fecd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:11.000580 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-34cdb77e-08ec-4b47-b2de-8bd28c36fecd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:11.001352 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-34cdb77e-08ec-4b47-b2de-8bd28c36fecd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:11.001783 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-34cdb77e-08ec-4b47-b2de-8bd28c36fecd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:11.072573 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-34cdb77e-08ec-4b47-b2de-8bd28c36fecd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.085092 Dec 27 14:26:11.073149 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 425/823] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:26:10 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:26:12.084508 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f904a74c-75d3-4fc6-b706-e9602ac3abe8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:26:12.085679 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f904a74c-75d3-4fc6-b706-e9602ac3abe8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:12.092667 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f904a74c-75d3-4fc6-b706-e9602ac3abe8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:12.093119 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f904a74c-75d3-4fc6-b706-e9602ac3abe8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:12.093914 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f904a74c-75d3-4fc6-b706-e9602ac3abe8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:12.094347 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f904a74c-75d3-4fc6-b706-e9602ac3abe8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:12.161729 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f904a74c-75d3-4fc6-b706-e9602ac3abe8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.081037 Dec 27 14:26:12.164138 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 399/824] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:26:12 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:26:13.174682 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-521a1f00-97e7-4d09-b092-a7b7aad289f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:26:13.175692 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-521a1f00-97e7-4d09-b092-a7b7aad289f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:13.183098 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-521a1f00-97e7-4d09-b092-a7b7aad289f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:13.183495 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-521a1f00-97e7-4d09-b092-a7b7aad289f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:13.184386 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-521a1f00-97e7-4d09-b092-a7b7aad289f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:13.184904 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-521a1f00-97e7-4d09-b092-a7b7aad289f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:13.274919 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-521a1f00-97e7-4d09-b092-a7b7aad289f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.104170 Dec 27 14:26:13.275816 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 426/825] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:26:13 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:26:14.287254 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2798c7da-5433-4444-8c08-0a045411449f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:26:14.288444 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2798c7da-5433-4444-8c08-0a045411449f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:14.295550 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2798c7da-5433-4444-8c08-0a045411449f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:14.299147 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2798c7da-5433-4444-8c08-0a045411449f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:14.300055 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2798c7da-5433-4444-8c08-0a045411449f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:14.300527 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2798c7da-5433-4444-8c08-0a045411449f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:14.387823 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2798c7da-5433-4444-8c08-0a045411449f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 28794 microversion: 2.20 time: 0.104536 Dec 27 14:26:14.388725 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 400/826] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:26:14 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 28794 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:26:15.400279 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e38b46f5-83c7-45bb-8d3b-481e1ebcb0ba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:26:15.401285 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e38b46f5-83c7-45bb-8d3b-481e1ebcb0ba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:15.409616 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e38b46f5-83c7-45bb-8d3b-481e1ebcb0ba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:15.410073 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e38b46f5-83c7-45bb-8d3b-481e1ebcb0ba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:15.410876 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e38b46f5-83c7-45bb-8d3b-481e1ebcb0ba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:15.411578 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e38b46f5-83c7-45bb-8d3b-481e1ebcb0ba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:15.499669 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e38b46f5-83c7-45bb-8d3b-481e1ebcb0ba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 29997 microversion: 2.20 time: 0.104450 Dec 27 14:26:15.500441 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 427/827] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:26:15 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 29997 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:26:16.510766 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-409db130-aa20-4343-bed8-46106e0cd9af tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:26:16.511853 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-409db130-aa20-4343-bed8-46106e0cd9af tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:16.518394 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-409db130-aa20-4343-bed8-46106e0cd9af tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:16.518846 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-409db130-aa20-4343-bed8-46106e0cd9af tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:16.519672 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-409db130-aa20-4343-bed8-46106e0cd9af tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:16.520131 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-409db130-aa20-4343-bed8-46106e0cd9af tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:16.608245 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-409db130-aa20-4343-bed8-46106e0cd9af tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 31857 microversion: 2.20 time: 0.101288 Dec 27 14:26:16.612290 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 401/828] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:26:16 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 31857 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:26:17.461788 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 27 14:26:17.462015 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: Mon Dec 27 14:26:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 27 14:26:17.620610 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d5023f7f-21fa-484a-85aa-fda5a3412914 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:26:17.621652 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d5023f7f-21fa-484a-85aa-fda5a3412914 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:17.628614 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d5023f7f-21fa-484a-85aa-fda5a3412914 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:17.629069 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d5023f7f-21fa-484a-85aa-fda5a3412914 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:17.629847 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d5023f7f-21fa-484a-85aa-fda5a3412914 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:17.630285 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d5023f7f-21fa-484a-85aa-fda5a3412914 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:17.726269 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d5023f7f-21fa-484a-85aa-fda5a3412914 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 33330 microversion: 2.20 time: 0.110096 Dec 27 14:26:17.727127 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 428/829] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:26:17 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 33330 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:26:18.738582 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9ef00df3-b0bf-4f34-bb91-4128b01d0425 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:26:18.739582 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9ef00df3-b0bf-4f34-bb91-4128b01d0425 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:18.746717 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ef00df3-b0bf-4f34-bb91-4128b01d0425 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:18.747167 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ef00df3-b0bf-4f34-bb91-4128b01d0425 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:18.747974 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ef00df3-b0bf-4f34-bb91-4128b01d0425 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:18.748412 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9ef00df3-b0bf-4f34-bb91-4128b01d0425 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:18.839125 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9ef00df3-b0bf-4f34-bb91-4128b01d0425 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 34129 microversion: 2.20 time: 0.104498 Dec 27 14:26:18.840505 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 402/830] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:26:18 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 34129 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:26:19.851695 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-07d8a233-8bc4-4cb1-8371-684715e073e0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:26:19.852773 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-07d8a233-8bc4-4cb1-8371-684715e073e0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:19.859633 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-07d8a233-8bc4-4cb1-8371-684715e073e0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:19.860119 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-07d8a233-8bc4-4cb1-8371-684715e073e0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:19.860908 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-07d8a233-8bc4-4cb1-8371-684715e073e0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:19.861369 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-07d8a233-8bc4-4cb1-8371-684715e073e0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:19.943990 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-07d8a233-8bc4-4cb1-8371-684715e073e0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 35159 microversion: 2.20 time: 0.096741 Dec 27 14:26:19.945337 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 429/831] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:26:19 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 35159 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:26:20.955957 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-36600723-4017-4329-bac1-984903cd9227 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:26:20.956989 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-36600723-4017-4329-bac1-984903cd9227 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:20.964104 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-36600723-4017-4329-bac1-984903cd9227 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:20.964559 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-36600723-4017-4329-bac1-984903cd9227 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:20.965410 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-36600723-4017-4329-bac1-984903cd9227 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:20.965778 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-36600723-4017-4329-bac1-984903cd9227 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:21.141079 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-36600723-4017-4329-bac1-984903cd9227 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 36508 microversion: 2.20 time: 0.189020 Dec 27 14:26:21.142696 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 403/832] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:26:20 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 36508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:26:22.153588 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-50392342-606b-4735-afbf-75bd5265a398 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:26:22.154878 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-50392342-606b-4735-afbf-75bd5265a398 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:22.162016 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-50392342-606b-4735-afbf-75bd5265a398 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:22.162464 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-50392342-606b-4735-afbf-75bd5265a398 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:22.163371 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-50392342-606b-4735-afbf-75bd5265a398 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:22.163814 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-50392342-606b-4735-afbf-75bd5265a398 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:24.400265 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-50392342-606b-4735-afbf-75bd5265a398 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 38349 microversion: 2.20 time: 2.250391 Dec 27 14:26:24.401289 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 430/833] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:26:22 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 38349 bytes in 2252 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:26:25.412822 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-816e256d-51fb-4723-9a36-1129cf37724a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:26:25.413750 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-816e256d-51fb-4723-9a36-1129cf37724a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:25.421532 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-816e256d-51fb-4723-9a36-1129cf37724a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:25.421982 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-816e256d-51fb-4723-9a36-1129cf37724a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:25.422764 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-816e256d-51fb-4723-9a36-1129cf37724a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:25.423206 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-816e256d-51fb-4723-9a36-1129cf37724a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:25.484621 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-816e256d-51fb-4723-9a36-1129cf37724a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 38349 microversion: 2.20 time: 0.075792 Dec 27 14:26:25.488807 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 404/834] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:26:25 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 38349 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:26:26.497014 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-43d87ad2-2517-4b12-b6b9-23c434838a80 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:26:26.498010 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-43d87ad2-2517-4b12-b6b9-23c434838a80 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:26.505556 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-43d87ad2-2517-4b12-b6b9-23c434838a80 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:26.506010 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-43d87ad2-2517-4b12-b6b9-23c434838a80 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:26.506791 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-43d87ad2-2517-4b12-b6b9-23c434838a80 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:26.507225 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-43d87ad2-2517-4b12-b6b9-23c434838a80 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:26.569445 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-43d87ad2-2517-4b12-b6b9-23c434838a80 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 38349 microversion: 2.20 time: 0.076373 Dec 27 14:26:26.570083 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 431/835] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:26:26 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 38349 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:26:27.582428 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-97f765fa-938a-46e9-964d-b1ae04d4d98f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:26:27.592091 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-97f765fa-938a-46e9-964d-b1ae04d4d98f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:27.599173 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-97f765fa-938a-46e9-964d-b1ae04d4d98f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:27.599633 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-97f765fa-938a-46e9-964d-b1ae04d4d98f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:27.600495 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-97f765fa-938a-46e9-964d-b1ae04d4d98f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:27.600936 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-97f765fa-938a-46e9-964d-b1ae04d4d98f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:27.682012 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-97f765fa-938a-46e9-964d-b1ae04d4d98f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 200 len: 38490 microversion: 2.20 time: 0.103426 Dec 27 14:26:27.682929 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 405/836] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:26:27 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 38490 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:26:27.692934 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7ffcc89b-5059-4d4a-ab80-d93bab4841a0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:27.693522 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7ffcc89b-5059-4d4a-ab80-d93bab4841a0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:27.701666 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7ffcc89b-5059-4d4a-ab80-d93bab4841a0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:27.702123 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7ffcc89b-5059-4d4a-ab80-d93bab4841a0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:27.702905 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7ffcc89b-5059-4d4a-ab80-d93bab4841a0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:27.703352 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7ffcc89b-5059-4d4a-ab80-d93bab4841a0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:27.727695 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7ffcc89b-5059-4d4a-ab80-d93bab4841a0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/ips" status: 200 len: 152 microversion: 2.20 time: 0.037712 Dec 27 14:26:27.728323 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 432/837] 10.222.0.37 () {60 vars in 1288 bytes} [Mon Dec 27 14:26:27 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:26:37.395025 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-35cd4cdf-f0ee-4301-b93e-ed7e6e3ea361 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:26:37.396017 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-35cd4cdf-f0ee-4301-b93e-ed7e6e3ea361 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:37.403628 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-35cd4cdf-f0ee-4301-b93e-ed7e6e3ea361 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:37.404106 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-35cd4cdf-f0ee-4301-b93e-ed7e6e3ea361 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:37.404890 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-35cd4cdf-f0ee-4301-b93e-ed7e6e3ea361 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:37.405586 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-35cd4cdf-f0ee-4301-b93e-ed7e6e3ea361 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:37.477954 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-35cd4cdf-f0ee-4301-b93e-ed7e6e3ea361 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "POST /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40/action" status: 202 len: 0 microversion: 2.1 time: 0.086938 Dec 27 14:26:37.478747 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 406/838] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:26:37 2021] POST /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:26:37.487177 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-27907029-c073-481a-bcc3-67a5be8a848d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:37.487791 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-27907029-c073-481a-bcc3-67a5be8a848d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:37.495269 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-27907029-c073-481a-bcc3-67a5be8a848d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:37.495830 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-27907029-c073-481a-bcc3-67a5be8a848d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:37.496870 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-27907029-c073-481a-bcc3-67a5be8a848d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:37.497946 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-27907029-c073-481a-bcc3-67a5be8a848d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:37.775087 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-27907029-c073-481a-bcc3-67a5be8a848d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:37.783244 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-27907029-c073-481a-bcc3-67a5be8a848d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1753 microversion: 2.1 time: 0.299841 Dec 27 14:26:37.783818 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 433/839] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:26:37 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1753 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:26:38.801305 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-85511daf-256e-4026-8326-116aa479285c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:38.802006 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-85511daf-256e-4026-8326-116aa479285c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:38.809133 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85511daf-256e-4026-8326-116aa479285c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:38.809617 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85511daf-256e-4026-8326-116aa479285c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:38.810396 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85511daf-256e-4026-8326-116aa479285c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:38.810835 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85511daf-256e-4026-8326-116aa479285c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:39.001775 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-85511daf-256e-4026-8326-116aa479285c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:39.009728 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-85511daf-256e-4026-8326-116aa479285c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1753 microversion: 2.1 time: 0.212369 Dec 27 14:26:39.010288 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 407/840] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:26:38 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1753 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:26:40.026965 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-725ce301-b38b-4572-a3ee-bf7ce1dfc302 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:40.027591 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-725ce301-b38b-4572-a3ee-bf7ce1dfc302 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:40.034277 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-725ce301-b38b-4572-a3ee-bf7ce1dfc302 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:40.034729 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-725ce301-b38b-4572-a3ee-bf7ce1dfc302 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:40.035541 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-725ce301-b38b-4572-a3ee-bf7ce1dfc302 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:40.036013 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-725ce301-b38b-4572-a3ee-bf7ce1dfc302 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:40.183264 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-725ce301-b38b-4572-a3ee-bf7ce1dfc302 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:40.192548 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-725ce301-b38b-4572-a3ee-bf7ce1dfc302 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1753 microversion: 2.1 time: 0.169967 Dec 27 14:26:40.193356 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 434/841] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:26:40 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:26:40.563827 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-85694c4f-8a51-4eb6-b6b7-0b31ff6dd61d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:26:40.564446 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-85694c4f-8a51-4eb6-b6b7-0b31ff6dd61d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:40.570699 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85694c4f-8a51-4eb6-b6b7-0b31ff6dd61d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:40.571255 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85694c4f-8a51-4eb6-b6b7-0b31ff6dd61d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:40.572058 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85694c4f-8a51-4eb6-b6b7-0b31ff6dd61d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:40.572495 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85694c4f-8a51-4eb6-b6b7-0b31ff6dd61d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:40.594595 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-85694c4f-8a51-4eb6-b6b7-0b31ff6dd61d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lazy-loading 'flavor' on Instance uuid aad07b94-d83b-4d44-856c-80ac2e24b8b4 {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:26:40.854909 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-85694c4f-8a51-4eb6-b6b7-0b31ff6dd61d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 202 len: 0 microversion: 2.20 time: 0.294529 Dec 27 14:26:40.855605 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 408/842] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:26:40 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 27 14:26:40.863704 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0506847f-d1d9-4ce3-9000-8303915213cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:40.864343 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0506847f-d1d9-4ce3-9000-8303915213cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:40.871103 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0506847f-d1d9-4ce3-9000-8303915213cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:40.871729 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0506847f-d1d9-4ce3-9000-8303915213cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:40.872808 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0506847f-d1d9-4ce3-9000-8303915213cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:40.873238 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0506847f-d1d9-4ce3-9000-8303915213cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:41.001820 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0506847f-d1d9-4ce3-9000-8303915213cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:41.009854 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0506847f-d1d9-4ce3-9000-8303915213cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:41.011411 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0506847f-d1d9-4ce3-9000-8303915213cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:41.012610 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0506847f-d1d9-4ce3-9000-8303915213cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1723 microversion: 2.20 time: 0.152607 Dec 27 14:26:41.013174 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 435/843] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:26:40 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:26:41.211718 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-baba47f3-78fd-4ef7-bba4-ab1d02929d3d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:41.212765 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-baba47f3-78fd-4ef7-bba4-ab1d02929d3d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:41.218825 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-baba47f3-78fd-4ef7-bba4-ab1d02929d3d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:41.219283 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-baba47f3-78fd-4ef7-bba4-ab1d02929d3d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:41.220090 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-baba47f3-78fd-4ef7-bba4-ab1d02929d3d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:41.220535 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-baba47f3-78fd-4ef7-bba4-ab1d02929d3d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:41.365680 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-baba47f3-78fd-4ef7-bba4-ab1d02929d3d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:41.374577 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-baba47f3-78fd-4ef7-bba4-ab1d02929d3d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1758 microversion: 2.1 time: 0.168007 Dec 27 14:26:41.375151 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 409/844] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:26:41 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:26:42.030897 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b01ece6b-ee28-416c-b569-d4f44e2d1c6f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:42.031429 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b01ece6b-ee28-416c-b569-d4f44e2d1c6f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:42.037707 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b01ece6b-ee28-416c-b569-d4f44e2d1c6f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:42.038287 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b01ece6b-ee28-416c-b569-d4f44e2d1c6f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:42.039062 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b01ece6b-ee28-416c-b569-d4f44e2d1c6f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:42.039549 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b01ece6b-ee28-416c-b569-d4f44e2d1c6f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:42.169267 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b01ece6b-ee28-416c-b569-d4f44e2d1c6f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:42.177013 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b01ece6b-ee28-416c-b569-d4f44e2d1c6f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:42.178683 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b01ece6b-ee28-416c-b569-d4f44e2d1c6f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:42.179858 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b01ece6b-ee28-416c-b569-d4f44e2d1c6f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1723 microversion: 2.20 time: 0.153005 Dec 27 14:26:42.180737 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 436/845] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:26:42 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:26:42.392277 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f1aedfe5-f626-4ee5-a169-8755d18ae17b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:42.392791 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f1aedfe5-f626-4ee5-a169-8755d18ae17b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:42.399334 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1aedfe5-f626-4ee5-a169-8755d18ae17b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:42.399781 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1aedfe5-f626-4ee5-a169-8755d18ae17b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:42.400590 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1aedfe5-f626-4ee5-a169-8755d18ae17b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:42.401027 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1aedfe5-f626-4ee5-a169-8755d18ae17b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:42.542221 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f1aedfe5-f626-4ee5-a169-8755d18ae17b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:42.549888 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f1aedfe5-f626-4ee5-a169-8755d18ae17b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1758 microversion: 2.1 time: 0.161341 Dec 27 14:26:42.550447 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 410/846] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:26:42 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:26:43.199320 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-12216142-b989-42d3-b2dc-230ab3c63df7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:43.199972 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-12216142-b989-42d3-b2dc-230ab3c63df7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:43.206290 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-12216142-b989-42d3-b2dc-230ab3c63df7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:43.206737 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-12216142-b989-42d3-b2dc-230ab3c63df7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:43.207505 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-12216142-b989-42d3-b2dc-230ab3c63df7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:43.207965 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-12216142-b989-42d3-b2dc-230ab3c63df7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:43.334025 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-12216142-b989-42d3-b2dc-230ab3c63df7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:43.342446 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-12216142-b989-42d3-b2dc-230ab3c63df7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:43.343967 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-12216142-b989-42d3-b2dc-230ab3c63df7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:43.345121 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-12216142-b989-42d3-b2dc-230ab3c63df7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1723 microversion: 2.20 time: 0.149710 Dec 27 14:26:43.345683 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 437/847] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:26:43 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:26:43.567874 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9538c4bf-77b6-45a5-8f78-8040f14701b9 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:43.568494 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9538c4bf-77b6-45a5-8f78-8040f14701b9 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:43.575347 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9538c4bf-77b6-45a5-8f78-8040f14701b9 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:43.575823 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9538c4bf-77b6-45a5-8f78-8040f14701b9 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:43.576661 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9538c4bf-77b6-45a5-8f78-8040f14701b9 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:43.577103 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9538c4bf-77b6-45a5-8f78-8040f14701b9 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:43.721700 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9538c4bf-77b6-45a5-8f78-8040f14701b9 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:43.729581 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9538c4bf-77b6-45a5-8f78-8040f14701b9 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1758 microversion: 2.1 time: 0.165510 Dec 27 14:26:43.730148 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 411/848] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:26:43 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:26:44.363527 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-bac61d06-40b3-43f1-81e9-7a86b05fdee0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:44.364159 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-bac61d06-40b3-43f1-81e9-7a86b05fdee0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:44.371299 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bac61d06-40b3-43f1-81e9-7a86b05fdee0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:44.371741 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bac61d06-40b3-43f1-81e9-7a86b05fdee0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:44.372544 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bac61d06-40b3-43f1-81e9-7a86b05fdee0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:44.372974 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bac61d06-40b3-43f1-81e9-7a86b05fdee0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:44.498079 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-bac61d06-40b3-43f1-81e9-7a86b05fdee0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:44.505543 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-bac61d06-40b3-43f1-81e9-7a86b05fdee0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:44.507033 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-bac61d06-40b3-43f1-81e9-7a86b05fdee0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:44.508172 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-bac61d06-40b3-43f1-81e9-7a86b05fdee0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1723 microversion: 2.20 time: 0.148336 Dec 27 14:26:44.508737 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 438/849] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:26:44 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:26:44.746297 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-16ea6d5c-55b6-43c6-a89b-5ba7d04a467b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:44.747032 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-16ea6d5c-55b6-43c6-a89b-5ba7d04a467b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:44.753474 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16ea6d5c-55b6-43c6-a89b-5ba7d04a467b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:44.753915 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16ea6d5c-55b6-43c6-a89b-5ba7d04a467b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:44.754686 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16ea6d5c-55b6-43c6-a89b-5ba7d04a467b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:44.755118 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16ea6d5c-55b6-43c6-a89b-5ba7d04a467b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:44.898651 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-16ea6d5c-55b6-43c6-a89b-5ba7d04a467b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:44.907860 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-16ea6d5c-55b6-43c6-a89b-5ba7d04a467b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1758 microversion: 2.1 time: 0.165223 Dec 27 14:26:44.908419 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 412/850] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:26:44 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:26:45.525825 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-869822ed-e6ac-4ad6-a5b4-d841b85b7dc7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:45.526430 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-869822ed-e6ac-4ad6-a5b4-d841b85b7dc7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:45.533777 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-869822ed-e6ac-4ad6-a5b4-d841b85b7dc7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:45.534222 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-869822ed-e6ac-4ad6-a5b4-d841b85b7dc7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:45.534996 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-869822ed-e6ac-4ad6-a5b4-d841b85b7dc7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:45.535432 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-869822ed-e6ac-4ad6-a5b4-d841b85b7dc7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:45.663616 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-869822ed-e6ac-4ad6-a5b4-d841b85b7dc7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:45.671670 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-869822ed-e6ac-4ad6-a5b4-d841b85b7dc7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:45.673196 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-869822ed-e6ac-4ad6-a5b4-d841b85b7dc7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:45.674372 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-869822ed-e6ac-4ad6-a5b4-d841b85b7dc7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1723 microversion: 2.20 time: 0.152254 Dec 27 14:26:45.674936 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 439/851] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:26:45 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:26:45.924886 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-000c306e-9760-4ea6-ae73-92396d303362 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:45.925678 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-000c306e-9760-4ea6-ae73-92396d303362 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:45.932055 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-000c306e-9760-4ea6-ae73-92396d303362 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:45.932504 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-000c306e-9760-4ea6-ae73-92396d303362 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:45.933357 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-000c306e-9760-4ea6-ae73-92396d303362 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:45.933821 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-000c306e-9760-4ea6-ae73-92396d303362 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:46.075446 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-000c306e-9760-4ea6-ae73-92396d303362 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:46.083743 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-000c306e-9760-4ea6-ae73-92396d303362 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1758 microversion: 2.1 time: 0.162687 Dec 27 14:26:46.084334 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 413/852] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:26:45 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:26:46.692400 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ba961dc1-f175-4dbb-bcc9-1893f50cd808 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:46.693006 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ba961dc1-f175-4dbb-bcc9-1893f50cd808 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:46.699236 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ba961dc1-f175-4dbb-bcc9-1893f50cd808 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:46.699990 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ba961dc1-f175-4dbb-bcc9-1893f50cd808 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:46.700759 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ba961dc1-f175-4dbb-bcc9-1893f50cd808 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:46.701184 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ba961dc1-f175-4dbb-bcc9-1893f50cd808 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:46.830434 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ba961dc1-f175-4dbb-bcc9-1893f50cd808 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:46.838682 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ba961dc1-f175-4dbb-bcc9-1893f50cd808 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:46.840714 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ba961dc1-f175-4dbb-bcc9-1893f50cd808 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:46.841865 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ba961dc1-f175-4dbb-bcc9-1893f50cd808 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1723 microversion: 2.20 time: 0.153122 Dec 27 14:26:46.842421 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 440/853] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:26:46 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:26:47.102890 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b37682e2-4eda-4099-b5ea-5ba758451a7e tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:47.103515 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b37682e2-4eda-4099-b5ea-5ba758451a7e tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:47.110025 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b37682e2-4eda-4099-b5ea-5ba758451a7e tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:47.110474 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b37682e2-4eda-4099-b5ea-5ba758451a7e tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:47.111286 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b37682e2-4eda-4099-b5ea-5ba758451a7e tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:47.111802 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b37682e2-4eda-4099-b5ea-5ba758451a7e tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:47.258955 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b37682e2-4eda-4099-b5ea-5ba758451a7e tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:47.270005 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b37682e2-4eda-4099-b5ea-5ba758451a7e tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1758 microversion: 2.1 time: 0.170421 Dec 27 14:26:47.270005 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 414/854] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:26:47 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:26:47.860374 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-62a9f756-5ebd-45c7-af88-5b31e55300a3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:47.860897 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-62a9f756-5ebd-45c7-af88-5b31e55300a3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:47.867396 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-62a9f756-5ebd-45c7-af88-5b31e55300a3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:47.867999 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-62a9f756-5ebd-45c7-af88-5b31e55300a3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:47.868784 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-62a9f756-5ebd-45c7-af88-5b31e55300a3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:47.869221 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-62a9f756-5ebd-45c7-af88-5b31e55300a3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:48.285091 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-eddf3700-6cba-4acd-b2d6-ec2953afbbfe tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:48.285707 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-eddf3700-6cba-4acd-b2d6-ec2953afbbfe tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:48.292582 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eddf3700-6cba-4acd-b2d6-ec2953afbbfe tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:48.293032 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eddf3700-6cba-4acd-b2d6-ec2953afbbfe tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:48.294119 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eddf3700-6cba-4acd-b2d6-ec2953afbbfe tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:48.294567 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eddf3700-6cba-4acd-b2d6-ec2953afbbfe tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:48.406380 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-62a9f756-5ebd-45c7-af88-5b31e55300a3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:48.414537 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-62a9f756-5ebd-45c7-af88-5b31e55300a3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:48.416397 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-62a9f756-5ebd-45c7-af88-5b31e55300a3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:48.417587 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-62a9f756-5ebd-45c7-af88-5b31e55300a3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1723 microversion: 2.20 time: 0.561649 Dec 27 14:26:48.428288 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 441/855] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:26:47 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1723 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:26:48.453439 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-eddf3700-6cba-4acd-b2d6-ec2953afbbfe tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:48.461350 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-eddf3700-6cba-4acd-b2d6-ec2953afbbfe tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1758 microversion: 2.1 time: 0.180078 Dec 27 14:26:48.461928 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 415/856] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:26:48 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:26:49.435809 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5cc48ee3-bc94-4f47-bb8c-730869c83972 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:49.436379 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5cc48ee3-bc94-4f47-bb8c-730869c83972 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:49.442644 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5cc48ee3-bc94-4f47-bb8c-730869c83972 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:49.443091 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5cc48ee3-bc94-4f47-bb8c-730869c83972 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:49.443898 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5cc48ee3-bc94-4f47-bb8c-730869c83972 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:49.444337 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5cc48ee3-bc94-4f47-bb8c-730869c83972 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:49.477972 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ddb19e83-4401-4bf7-a54d-4a5b42b94c87 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:49.478586 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ddb19e83-4401-4bf7-a54d-4a5b42b94c87 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:49.484965 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ddb19e83-4401-4bf7-a54d-4a5b42b94c87 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:49.485420 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ddb19e83-4401-4bf7-a54d-4a5b42b94c87 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:49.486236 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ddb19e83-4401-4bf7-a54d-4a5b42b94c87 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:49.486673 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ddb19e83-4401-4bf7-a54d-4a5b42b94c87 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:49.573597 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5cc48ee3-bc94-4f47-bb8c-730869c83972 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:49.582018 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5cc48ee3-bc94-4f47-bb8c-730869c83972 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:49.583503 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5cc48ee3-bc94-4f47-bb8c-730869c83972 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:49.584678 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5cc48ee3-bc94-4f47-bb8c-730869c83972 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1723 microversion: 2.20 time: 0.152662 Dec 27 14:26:49.585234 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 442/857] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:26:49 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:26:49.636034 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ddb19e83-4401-4bf7-a54d-4a5b42b94c87 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:49.645105 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ddb19e83-4401-4bf7-a54d-4a5b42b94c87 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1758 microversion: 2.1 time: 0.170749 Dec 27 14:26:49.645682 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 416/858] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:26:49 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:26:50.602249 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-48817444-1dd6-40f8-a18e-e2cf8926de84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:50.602887 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-48817444-1dd6-40f8-a18e-e2cf8926de84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:50.609900 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-48817444-1dd6-40f8-a18e-e2cf8926de84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:50.610342 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-48817444-1dd6-40f8-a18e-e2cf8926de84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:50.611118 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-48817444-1dd6-40f8-a18e-e2cf8926de84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:50.611547 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-48817444-1dd6-40f8-a18e-e2cf8926de84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:50.663008 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-351dbf21-fe84-4211-9dee-35d930b4a2e2 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:50.663633 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-351dbf21-fe84-4211-9dee-35d930b4a2e2 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:50.670498 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-351dbf21-fe84-4211-9dee-35d930b4a2e2 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:50.670945 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-351dbf21-fe84-4211-9dee-35d930b4a2e2 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:50.671724 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-351dbf21-fe84-4211-9dee-35d930b4a2e2 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:50.672187 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-351dbf21-fe84-4211-9dee-35d930b4a2e2 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:50.743307 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-48817444-1dd6-40f8-a18e-e2cf8926de84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:50.751245 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-48817444-1dd6-40f8-a18e-e2cf8926de84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:50.752745 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-48817444-1dd6-40f8-a18e-e2cf8926de84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:50.753881 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-48817444-1dd6-40f8-a18e-e2cf8926de84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1723 microversion: 2.20 time: 0.155321 Dec 27 14:26:50.754433 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 443/859] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:26:50 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:26:50.819853 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-351dbf21-fe84-4211-9dee-35d930b4a2e2 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:50.828270 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-351dbf21-fe84-4211-9dee-35d930b4a2e2 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1758 microversion: 2.1 time: 0.168845 Dec 27 14:26:50.828824 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 417/860] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:26:50 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:26:51.772027 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3edb125b-ffbc-424e-81d7-3c7d8226b3a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:51.772725 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3edb125b-ffbc-424e-81d7-3c7d8226b3a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:51.780213 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3edb125b-ffbc-424e-81d7-3c7d8226b3a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:51.780667 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3edb125b-ffbc-424e-81d7-3c7d8226b3a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:51.781451 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3edb125b-ffbc-424e-81d7-3c7d8226b3a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:51.781885 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3edb125b-ffbc-424e-81d7-3c7d8226b3a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:51.846954 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f4fe534c-3c4c-4b78-b042-5c175b22d95f tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:51.847727 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f4fe534c-3c4c-4b78-b042-5c175b22d95f tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:51.853874 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f4fe534c-3c4c-4b78-b042-5c175b22d95f tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:51.854515 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f4fe534c-3c4c-4b78-b042-5c175b22d95f tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:51.855325 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f4fe534c-3c4c-4b78-b042-5c175b22d95f tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:51.855949 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f4fe534c-3c4c-4b78-b042-5c175b22d95f tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:51.913038 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3edb125b-ffbc-424e-81d7-3c7d8226b3a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:51.921129 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3edb125b-ffbc-424e-81d7-3c7d8226b3a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:51.922605 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3edb125b-ffbc-424e-81d7-3c7d8226b3a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:51.923749 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3edb125b-ffbc-424e-81d7-3c7d8226b3a2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1723 microversion: 2.20 time: 0.155786 Dec 27 14:26:51.924338 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 444/861] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:26:51 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:26:52.003959 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f4fe534c-3c4c-4b78-b042-5c175b22d95f tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:52.011587 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f4fe534c-3c4c-4b78-b042-5c175b22d95f tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1758 microversion: 2.1 time: 0.168309 Dec 27 14:26:52.012807 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 418/862] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:26:51 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:26:52.944109 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-710abcd8-7d92-49e2-8f41-ff4415cbe457 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:52.944796 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-710abcd8-7d92-49e2-8f41-ff4415cbe457 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:52.951331 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-710abcd8-7d92-49e2-8f41-ff4415cbe457 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:52.951778 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-710abcd8-7d92-49e2-8f41-ff4415cbe457 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:52.952591 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-710abcd8-7d92-49e2-8f41-ff4415cbe457 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:52.953021 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-710abcd8-7d92-49e2-8f41-ff4415cbe457 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:53.031667 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-08c1ccfc-f224-4c4c-8018-539939973271 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:53.032767 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-08c1ccfc-f224-4c4c-8018-539939973271 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:53.042552 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-08c1ccfc-f224-4c4c-8018-539939973271 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:53.043963 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-08c1ccfc-f224-4c4c-8018-539939973271 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:53.045298 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-08c1ccfc-f224-4c4c-8018-539939973271 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:53.046083 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-08c1ccfc-f224-4c4c-8018-539939973271 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:53.092685 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-710abcd8-7d92-49e2-8f41-ff4415cbe457 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:53.102066 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-710abcd8-7d92-49e2-8f41-ff4415cbe457 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:53.103560 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-710abcd8-7d92-49e2-8f41-ff4415cbe457 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:53.104758 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-710abcd8-7d92-49e2-8f41-ff4415cbe457 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1723 microversion: 2.20 time: 0.164563 Dec 27 14:26:53.105355 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 445/863] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:26:52 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:26:53.202664 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-08c1ccfc-f224-4c4c-8018-539939973271 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:53.210524 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-08c1ccfc-f224-4c4c-8018-539939973271 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1758 microversion: 2.1 time: 0.184406 Dec 27 14:26:53.211096 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 419/864] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:26:53 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:26:54.124303 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4367a372-c14a-40e5-817f-88fb93acf286 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:54.124917 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4367a372-c14a-40e5-817f-88fb93acf286 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:54.131017 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4367a372-c14a-40e5-817f-88fb93acf286 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:54.131526 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4367a372-c14a-40e5-817f-88fb93acf286 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:54.132353 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4367a372-c14a-40e5-817f-88fb93acf286 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:54.132786 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4367a372-c14a-40e5-817f-88fb93acf286 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:54.228476 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a91b31b7-c7c5-4d45-99c3-39bd1d6eef96 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:54.229086 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a91b31b7-c7c5-4d45-99c3-39bd1d6eef96 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:54.236197 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a91b31b7-c7c5-4d45-99c3-39bd1d6eef96 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:54.236645 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a91b31b7-c7c5-4d45-99c3-39bd1d6eef96 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:54.237427 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a91b31b7-c7c5-4d45-99c3-39bd1d6eef96 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:54.237856 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a91b31b7-c7c5-4d45-99c3-39bd1d6eef96 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:54.272444 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4367a372-c14a-40e5-817f-88fb93acf286 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:54.281500 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4367a372-c14a-40e5-817f-88fb93acf286 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:54.283007 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4367a372-c14a-40e5-817f-88fb93acf286 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:54.284186 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4367a372-c14a-40e5-817f-88fb93acf286 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1723 microversion: 2.20 time: 0.164340 Dec 27 14:26:54.284740 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 446/865] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:26:54 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:26:54.384928 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a91b31b7-c7c5-4d45-99c3-39bd1d6eef96 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:54.393177 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a91b31b7-c7c5-4d45-99c3-39bd1d6eef96 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1758 microversion: 2.1 time: 0.168046 Dec 27 14:26:54.393590 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 420/866] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:26:54 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:26:55.302201 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e1a22b6b-6da8-453a-81c0-28592d7e39c5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:55.302811 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e1a22b6b-6da8-453a-81c0-28592d7e39c5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:55.309605 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e1a22b6b-6da8-453a-81c0-28592d7e39c5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:55.310051 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e1a22b6b-6da8-453a-81c0-28592d7e39c5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:55.310833 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e1a22b6b-6da8-453a-81c0-28592d7e39c5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:55.311266 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e1a22b6b-6da8-453a-81c0-28592d7e39c5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:55.411279 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-36cb0e50-9ee8-407b-87d8-53fa5af6ced6 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:55.412006 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-36cb0e50-9ee8-407b-87d8-53fa5af6ced6 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:55.418904 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-36cb0e50-9ee8-407b-87d8-53fa5af6ced6 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:55.419772 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-36cb0e50-9ee8-407b-87d8-53fa5af6ced6 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:55.420585 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-36cb0e50-9ee8-407b-87d8-53fa5af6ced6 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:55.421015 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-36cb0e50-9ee8-407b-87d8-53fa5af6ced6 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:55.489570 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e1a22b6b-6da8-453a-81c0-28592d7e39c5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:55.498980 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e1a22b6b-6da8-453a-81c0-28592d7e39c5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:55.502082 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e1a22b6b-6da8-453a-81c0-28592d7e39c5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:55.503473 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e1a22b6b-6da8-453a-81c0-28592d7e39c5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1723 microversion: 2.20 time: 0.204978 Dec 27 14:26:55.504300 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 447/867] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:26:55 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:26:55.579388 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-36cb0e50-9ee8-407b-87d8-53fa5af6ced6 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:55.587370 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-36cb0e50-9ee8-407b-87d8-53fa5af6ced6 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1758 microversion: 2.1 time: 0.179744 Dec 27 14:26:55.588217 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 421/868] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:26:55 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:26:56.522471 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6c09b7b2-e312-45aa-a89f-9371d270cd94 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:56.523086 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6c09b7b2-e312-45aa-a89f-9371d270cd94 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:56.530208 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c09b7b2-e312-45aa-a89f-9371d270cd94 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:56.530664 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c09b7b2-e312-45aa-a89f-9371d270cd94 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:56.531442 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c09b7b2-e312-45aa-a89f-9371d270cd94 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:56.531913 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c09b7b2-e312-45aa-a89f-9371d270cd94 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:56.604857 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f6de0109-a828-4175-9326-13612437cc1c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:56.606211 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f6de0109-a828-4175-9326-13612437cc1c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:56.612912 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f6de0109-a828-4175-9326-13612437cc1c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:56.613463 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f6de0109-a828-4175-9326-13612437cc1c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:56.614316 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f6de0109-a828-4175-9326-13612437cc1c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:56.614830 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f6de0109-a828-4175-9326-13612437cc1c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:56.662032 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6c09b7b2-e312-45aa-a89f-9371d270cd94 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:56.671221 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6c09b7b2-e312-45aa-a89f-9371d270cd94 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:56.672972 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6c09b7b2-e312-45aa-a89f-9371d270cd94 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:56.674350 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6c09b7b2-e312-45aa-a89f-9371d270cd94 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1723 microversion: 2.20 time: 0.155735 Dec 27 14:26:56.674895 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 448/869] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:26:56 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:26:56.772361 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f6de0109-a828-4175-9326-13612437cc1c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:56.782816 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f6de0109-a828-4175-9326-13612437cc1c tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1758 microversion: 2.1 time: 0.181451 Dec 27 14:26:56.783553 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 422/870] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:26:56 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:26:57.692290 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3a98f307-1838-4c5a-b373-b9dadacc1be3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:57.692900 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3a98f307-1838-4c5a-b373-b9dadacc1be3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:57.699667 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a98f307-1838-4c5a-b373-b9dadacc1be3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:57.700148 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a98f307-1838-4c5a-b373-b9dadacc1be3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:57.700918 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a98f307-1838-4c5a-b373-b9dadacc1be3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:57.701353 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3a98f307-1838-4c5a-b373-b9dadacc1be3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:57.801879 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b947da28-8cdf-4d78-b2b6-09e1ac107cd0 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:57.802416 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b947da28-8cdf-4d78-b2b6-09e1ac107cd0 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:57.808919 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b947da28-8cdf-4d78-b2b6-09e1ac107cd0 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:57.809588 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b947da28-8cdf-4d78-b2b6-09e1ac107cd0 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:57.811487 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b947da28-8cdf-4d78-b2b6-09e1ac107cd0 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:57.812073 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b947da28-8cdf-4d78-b2b6-09e1ac107cd0 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:57.834678 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3a98f307-1838-4c5a-b373-b9dadacc1be3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:57.842992 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3a98f307-1838-4c5a-b373-b9dadacc1be3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:57.844519 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3a98f307-1838-4c5a-b373-b9dadacc1be3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:57.845698 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3a98f307-1838-4c5a-b373-b9dadacc1be3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1723 microversion: 2.20 time: 0.157150 Dec 27 14:26:57.846248 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 449/871] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:26:57 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:26:57.959735 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b947da28-8cdf-4d78-b2b6-09e1ac107cd0 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:57.969116 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b947da28-8cdf-4d78-b2b6-09e1ac107cd0 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1761 microversion: 2.1 time: 0.170934 Dec 27 14:26:57.969689 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 423/872] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:26:57 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1761 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:26:58.863454 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fa599ccc-38d9-4825-acc1-3418c1bb330a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:26:58.864068 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fa599ccc-38d9-4825-acc1-3418c1bb330a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:26:58.870268 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fa599ccc-38d9-4825-acc1-3418c1bb330a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:58.870716 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fa599ccc-38d9-4825-acc1-3418c1bb330a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:58.872343 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fa599ccc-38d9-4825-acc1-3418c1bb330a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:26:58.872776 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fa599ccc-38d9-4825-acc1-3418c1bb330a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:26:59.007164 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-fa599ccc-38d9-4825-acc1-3418c1bb330a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:59.015740 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-fa599ccc-38d9-4825-acc1-3418c1bb330a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:59.017272 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-fa599ccc-38d9-4825-acc1-3418c1bb330a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:26:59.018428 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fa599ccc-38d9-4825-acc1-3418c1bb330a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1723 microversion: 2.20 time: 0.158617 Dec 27 14:26:59.018992 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 450/873] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:26:58 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:00.036844 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-17e45e89-2a17-4923-adf1-d7cf89b38730 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:00.037354 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-17e45e89-2a17-4923-adf1-d7cf89b38730 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:00.043870 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17e45e89-2a17-4923-adf1-d7cf89b38730 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:00.044306 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17e45e89-2a17-4923-adf1-d7cf89b38730 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:00.045137 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17e45e89-2a17-4923-adf1-d7cf89b38730 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:00.045573 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17e45e89-2a17-4923-adf1-d7cf89b38730 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:00.178813 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-17e45e89-2a17-4923-adf1-d7cf89b38730 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:00.186778 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-17e45e89-2a17-4923-adf1-d7cf89b38730 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:00.188456 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-17e45e89-2a17-4923-adf1-d7cf89b38730 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:00.189606 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-17e45e89-2a17-4923-adf1-d7cf89b38730 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1723 microversion: 2.20 time: 0.156525 Dec 27 14:27:00.190233 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 424/874] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:00 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:27:01.208630 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-11dc2145-b7b9-4177-8f07-bc706f37e90c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:01.209266 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-11dc2145-b7b9-4177-8f07-bc706f37e90c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:01.216105 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-11dc2145-b7b9-4177-8f07-bc706f37e90c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:01.216557 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-11dc2145-b7b9-4177-8f07-bc706f37e90c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:01.217337 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-11dc2145-b7b9-4177-8f07-bc706f37e90c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:01.217778 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-11dc2145-b7b9-4177-8f07-bc706f37e90c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:01.347182 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-11dc2145-b7b9-4177-8f07-bc706f37e90c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:01.354875 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-11dc2145-b7b9-4177-8f07-bc706f37e90c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:01.356489 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-11dc2145-b7b9-4177-8f07-bc706f37e90c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:01.357640 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-11dc2145-b7b9-4177-8f07-bc706f37e90c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1723 microversion: 2.20 time: 0.153033 Dec 27 14:27:01.358191 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 451/875] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:01 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:02.377038 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ec77da9d-0fda-4fd3-8918-8aa995e0e843 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:02.377928 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ec77da9d-0fda-4fd3-8918-8aa995e0e843 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:02.385158 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ec77da9d-0fda-4fd3-8918-8aa995e0e843 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:02.385601 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ec77da9d-0fda-4fd3-8918-8aa995e0e843 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:02.386487 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ec77da9d-0fda-4fd3-8918-8aa995e0e843 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:02.387126 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ec77da9d-0fda-4fd3-8918-8aa995e0e843 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:02.521523 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ec77da9d-0fda-4fd3-8918-8aa995e0e843 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:02.530090 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ec77da9d-0fda-4fd3-8918-8aa995e0e843 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:02.531598 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ec77da9d-0fda-4fd3-8918-8aa995e0e843 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:02.532779 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ec77da9d-0fda-4fd3-8918-8aa995e0e843 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1723 microversion: 2.20 time: 0.160551 Dec 27 14:27:02.533347 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 425/876] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:02 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:03.551065 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-71c4dfbd-9cea-4bca-b6b4-56367e0ab75b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:03.551699 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-71c4dfbd-9cea-4bca-b6b4-56367e0ab75b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:03.557947 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-71c4dfbd-9cea-4bca-b6b4-56367e0ab75b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:03.558588 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-71c4dfbd-9cea-4bca-b6b4-56367e0ab75b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:03.559360 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-71c4dfbd-9cea-4bca-b6b4-56367e0ab75b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:03.559792 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-71c4dfbd-9cea-4bca-b6b4-56367e0ab75b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:03.695287 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-71c4dfbd-9cea-4bca-b6b4-56367e0ab75b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:03.703651 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-71c4dfbd-9cea-4bca-b6b4-56367e0ab75b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:03.705167 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-71c4dfbd-9cea-4bca-b6b4-56367e0ab75b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:03.706315 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-71c4dfbd-9cea-4bca-b6b4-56367e0ab75b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1744 microversion: 2.20 time: 0.158940 Dec 27 14:27:03.706872 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 452/877] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:03 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:04.725109 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f59c484a-a3b2-4ef5-885d-83e5c159ca6a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:04.725719 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f59c484a-a3b2-4ef5-885d-83e5c159ca6a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:04.732697 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f59c484a-a3b2-4ef5-885d-83e5c159ca6a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:04.733263 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f59c484a-a3b2-4ef5-885d-83e5c159ca6a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:04.734060 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f59c484a-a3b2-4ef5-885d-83e5c159ca6a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:04.734506 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f59c484a-a3b2-4ef5-885d-83e5c159ca6a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:04.874492 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f59c484a-a3b2-4ef5-885d-83e5c159ca6a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:04.882615 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f59c484a-a3b2-4ef5-885d-83e5c159ca6a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:04.884158 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f59c484a-a3b2-4ef5-885d-83e5c159ca6a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:04.885460 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f59c484a-a3b2-4ef5-885d-83e5c159ca6a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1744 microversion: 2.20 time: 0.164220 Dec 27 14:27:04.886019 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 426/878] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:04 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:05.905480 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-866af202-c2a1-450f-b11b-517c3854f19a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:05.906061 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-866af202-c2a1-450f-b11b-517c3854f19a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:05.912278 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-866af202-c2a1-450f-b11b-517c3854f19a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:05.912726 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-866af202-c2a1-450f-b11b-517c3854f19a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:05.913492 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-866af202-c2a1-450f-b11b-517c3854f19a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:05.913922 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-866af202-c2a1-450f-b11b-517c3854f19a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:06.048696 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-866af202-c2a1-450f-b11b-517c3854f19a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:06.056283 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-866af202-c2a1-450f-b11b-517c3854f19a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:06.057837 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-866af202-c2a1-450f-b11b-517c3854f19a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:06.059800 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-866af202-c2a1-450f-b11b-517c3854f19a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1744 microversion: 2.20 time: 0.159034 Dec 27 14:27:06.060417 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 453/879] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:05 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:06.956925 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-03e7c3ba-5728-46cc-abaf-333c78a87039 req-1edbe5da-2c31-48d5-b0ea-f6921843ff89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aad07b94-d83b-4d44-856c-80ac2e24b8b4", "name": "network-vif-plugged", "status": "completed", "tag": "d8953eb3-d364-4473-98c5-e33562dcd960"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:27:06.958527 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:27:06.958527 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:27:06.966093 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-03e7c3ba-5728-46cc-abaf-333c78a87039 req-1edbe5da-2c31-48d5-b0ea-f6921843ff89 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:06.966539 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-03e7c3ba-5728-46cc-abaf-333c78a87039 req-1edbe5da-2c31-48d5-b0ea-f6921843ff89 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:06.977178 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-03e7c3ba-5728-46cc-abaf-333c78a87039 req-1edbe5da-2c31-48d5-b0ea-f6921843ff89 service nova] Creating event network-vif-plugged:d8953eb3-d364-4473-98c5-e33562dcd960 for instance aad07b94-d83b-4d44-856c-80ac2e24b8b4 on hv-cinder-82301 Dec 27 14:27:06.982879 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-03e7c3ba-5728-46cc-abaf-333c78a87039 req-1edbe5da-2c31-48d5-b0ea-f6921843ff89 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160746 Dec 27 14:27:06.983508 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 427/880] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:27:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:27:07.077621 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2160ce21-27d6-4e4a-8a62-838814bcfad9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:07.078227 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2160ce21-27d6-4e4a-8a62-838814bcfad9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:07.084533 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2160ce21-27d6-4e4a-8a62-838814bcfad9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:07.085015 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2160ce21-27d6-4e4a-8a62-838814bcfad9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:07.085793 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2160ce21-27d6-4e4a-8a62-838814bcfad9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:07.086228 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2160ce21-27d6-4e4a-8a62-838814bcfad9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:07.221583 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-2160ce21-27d6-4e4a-8a62-838814bcfad9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:07.231818 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-2160ce21-27d6-4e4a-8a62-838814bcfad9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:07.233691 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-2160ce21-27d6-4e4a-8a62-838814bcfad9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:07.235136 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2160ce21-27d6-4e4a-8a62-838814bcfad9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1744 microversion: 2.20 time: 0.161222 Dec 27 14:27:07.235699 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 454/881] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:07 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:08.254632 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e333af19-b3d7-400d-828b-57bc86d64267 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:08.255320 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e333af19-b3d7-400d-828b-57bc86d64267 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:08.261454 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e333af19-b3d7-400d-828b-57bc86d64267 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:08.261905 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e333af19-b3d7-400d-828b-57bc86d64267 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:08.263057 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e333af19-b3d7-400d-828b-57bc86d64267 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:08.263493 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e333af19-b3d7-400d-828b-57bc86d64267 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:08.397238 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e333af19-b3d7-400d-828b-57bc86d64267 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:08.406428 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e333af19-b3d7-400d-828b-57bc86d64267 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:08.408037 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e333af19-b3d7-400d-828b-57bc86d64267 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:08.409189 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e333af19-b3d7-400d-828b-57bc86d64267 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1744 microversion: 2.20 time: 0.159051 Dec 27 14:27:08.409742 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 428/882] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:08 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:09.428447 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-25d1fafd-2efc-4993-8ae8-4353167c96f0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:09.429065 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-25d1fafd-2efc-4993-8ae8-4353167c96f0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:09.437200 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-25d1fafd-2efc-4993-8ae8-4353167c96f0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:09.438036 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-25d1fafd-2efc-4993-8ae8-4353167c96f0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:09.439067 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-25d1fafd-2efc-4993-8ae8-4353167c96f0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:09.439865 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-25d1fafd-2efc-4993-8ae8-4353167c96f0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:09.610295 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-25d1fafd-2efc-4993-8ae8-4353167c96f0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:09.620935 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-25d1fafd-2efc-4993-8ae8-4353167c96f0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:09.628979 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-25d1fafd-2efc-4993-8ae8-4353167c96f0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:09.630962 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-25d1fafd-2efc-4993-8ae8-4353167c96f0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1739 microversion: 2.20 time: 0.206646 Dec 27 14:27:09.633065 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 455/883] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:09 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:10.652604 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-62430d2a-f390-452d-a6cb-c62bfb40a459 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:10.653387 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-62430d2a-f390-452d-a6cb-c62bfb40a459 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:10.661324 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62430d2a-f390-452d-a6cb-c62bfb40a459 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:10.661770 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62430d2a-f390-452d-a6cb-c62bfb40a459 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:10.662570 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62430d2a-f390-452d-a6cb-c62bfb40a459 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:10.663005 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62430d2a-f390-452d-a6cb-c62bfb40a459 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:10.822138 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-62430d2a-f390-452d-a6cb-c62bfb40a459 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:10.831979 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-62430d2a-f390-452d-a6cb-c62bfb40a459 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:10.833724 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-62430d2a-f390-452d-a6cb-c62bfb40a459 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:10.834956 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-62430d2a-f390-452d-a6cb-c62bfb40a459 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1739 microversion: 2.20 time: 0.186653 Dec 27 14:27:10.835718 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 429/884] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:10 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:11.852765 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c1f5fb1c-08e5-4dc4-bd24-5580cba59b0e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:11.853465 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c1f5fb1c-08e5-4dc4-bd24-5580cba59b0e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:11.860476 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c1f5fb1c-08e5-4dc4-bd24-5580cba59b0e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:11.861282 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c1f5fb1c-08e5-4dc4-bd24-5580cba59b0e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:11.862101 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c1f5fb1c-08e5-4dc4-bd24-5580cba59b0e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:11.862542 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c1f5fb1c-08e5-4dc4-bd24-5580cba59b0e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:12.004471 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c1f5fb1c-08e5-4dc4-bd24-5580cba59b0e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:12.012575 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c1f5fb1c-08e5-4dc4-bd24-5580cba59b0e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:12.015190 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c1f5fb1c-08e5-4dc4-bd24-5580cba59b0e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:12.015823 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c1f5fb1c-08e5-4dc4-bd24-5580cba59b0e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1739 microversion: 2.20 time: 0.167014 Dec 27 14:27:12.016629 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 456/885] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:11 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:12.509446 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-895b51f7-9d14-44ae-aec3-a99d912d7b19 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:12.510430 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-895b51f7-9d14-44ae-aec3-a99d912d7b19 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:12.517114 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-895b51f7-9d14-44ae-aec3-a99d912d7b19 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:12.517833 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-895b51f7-9d14-44ae-aec3-a99d912d7b19 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:12.518798 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-895b51f7-9d14-44ae-aec3-a99d912d7b19 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:12.519396 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-895b51f7-9d14-44ae-aec3-a99d912d7b19 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:12.619351 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-895b51f7-9d14-44ae-aec3-a99d912d7b19 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lazy-loading 'services' on Instance uuid 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:27:12.704797 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-895b51f7-9d14-44ae-aec3-a99d912d7b19 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "DELETE /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/os-volume_attachments/9e397537-fa1a-498a-bee6-6493ab53fcbb" status: 202 len: 0 microversion: 2.1 time: 0.321023 Dec 27 14:27:12.705388 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 430/886] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Dec 27 14:27:12 2021] DELETE /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/os-volume_attachments/9e397537-fa1a-498a-bee6-6493ab53fcbb => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:27:13.034870 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-99657dd8-b2b8-4d5f-9d25-908f66ff5b5a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:13.036173 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-99657dd8-b2b8-4d5f-9d25-908f66ff5b5a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:13.042906 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99657dd8-b2b8-4d5f-9d25-908f66ff5b5a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:13.043359 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99657dd8-b2b8-4d5f-9d25-908f66ff5b5a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:13.044195 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99657dd8-b2b8-4d5f-9d25-908f66ff5b5a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:13.044875 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-99657dd8-b2b8-4d5f-9d25-908f66ff5b5a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:13.220714 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-99657dd8-b2b8-4d5f-9d25-908f66ff5b5a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:13.229614 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-99657dd8-b2b8-4d5f-9d25-908f66ff5b5a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:13.231415 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-99657dd8-b2b8-4d5f-9d25-908f66ff5b5a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:13.233323 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-99657dd8-b2b8-4d5f-9d25-908f66ff5b5a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1739 microversion: 2.20 time: 0.201749 Dec 27 14:27:13.235006 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 457/887] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:13 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:13.846401 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-26d3f93b-0953-4b07-9253-f9362dedefb0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:27:13.853426 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-26d3f93b-0953-4b07-9253-f9362dedefb0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:13.853893 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-26d3f93b-0953-4b07-9253-f9362dedefb0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:13.917895 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-26d3f93b-0953-4b07-9253-f9362dedefb0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Going to try to stop instance {{(pid=116104) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 27 14:27:13.966318 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-26d3f93b-0953-4b07-9253-f9362dedefb0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 202 len: 0 microversion: 2.1 time: 0.124300 Dec 27 14:27:13.968209 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 431/888] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:27:13 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:27:13.977128 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d52b1ece-eb48-4b0b-8fcb-284c2e476bad tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:13.977775 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d52b1ece-eb48-4b0b-8fcb-284c2e476bad tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:13.984297 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d52b1ece-eb48-4b0b-8fcb-284c2e476bad tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:13.985192 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d52b1ece-eb48-4b0b-8fcb-284c2e476bad tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:13.986084 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d52b1ece-eb48-4b0b-8fcb-284c2e476bad tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:13.986393 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d52b1ece-eb48-4b0b-8fcb-284c2e476bad tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:14.132647 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d52b1ece-eb48-4b0b-8fcb-284c2e476bad tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:14.145835 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d52b1ece-eb48-4b0b-8fcb-284c2e476bad tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.172271 Dec 27 14:27:14.146549 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 458/889] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:13 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:14.253934 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c94fbf7b-62d1-40eb-bc03-6b3c0358811f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:14.256353 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c94fbf7b-62d1-40eb-bc03-6b3c0358811f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:14.266617 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c94fbf7b-62d1-40eb-bc03-6b3c0358811f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:14.267345 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c94fbf7b-62d1-40eb-bc03-6b3c0358811f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:14.268437 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c94fbf7b-62d1-40eb-bc03-6b3c0358811f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:14.269083 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c94fbf7b-62d1-40eb-bc03-6b3c0358811f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:14.417289 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c94fbf7b-62d1-40eb-bc03-6b3c0358811f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:14.426320 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c94fbf7b-62d1-40eb-bc03-6b3c0358811f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:14.427827 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c94fbf7b-62d1-40eb-bc03-6b3c0358811f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:14.429040 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c94fbf7b-62d1-40eb-bc03-6b3c0358811f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1739 microversion: 2.20 time: 0.180472 Dec 27 14:27:14.429967 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 432/890] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:14 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:15.166763 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-19bfe575-68a9-4ed2-b90a-a59da844c9c5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:15.167368 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-19bfe575-68a9-4ed2-b90a-a59da844c9c5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:15.175686 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-19bfe575-68a9-4ed2-b90a-a59da844c9c5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:15.176268 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-19bfe575-68a9-4ed2-b90a-a59da844c9c5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:15.177097 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-19bfe575-68a9-4ed2-b90a-a59da844c9c5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:15.177538 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-19bfe575-68a9-4ed2-b90a-a59da844c9c5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:15.334492 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-19bfe575-68a9-4ed2-b90a-a59da844c9c5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:15.356320 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-19bfe575-68a9-4ed2-b90a-a59da844c9c5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.179900 Dec 27 14:27:15.367467 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 459/891] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:15 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:15.448656 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-453e0557-242f-42cb-81d2-d66acb12244d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:15.449358 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-453e0557-242f-42cb-81d2-d66acb12244d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:15.456882 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-453e0557-242f-42cb-81d2-d66acb12244d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:15.457816 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-453e0557-242f-42cb-81d2-d66acb12244d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:15.458142 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-453e0557-242f-42cb-81d2-d66acb12244d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:15.458583 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-453e0557-242f-42cb-81d2-d66acb12244d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:15.604195 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-453e0557-242f-42cb-81d2-d66acb12244d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:15.612462 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-453e0557-242f-42cb-81d2-d66acb12244d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:15.613945 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-453e0557-242f-42cb-81d2-d66acb12244d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:15.615099 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-453e0557-242f-42cb-81d2-d66acb12244d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1739 microversion: 2.20 time: 0.170412 Dec 27 14:27:15.616205 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 433/892] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:15 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:16.374034 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9704abdc-363c-43c4-a5d1-63e395311f70 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:16.374640 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9704abdc-363c-43c4-a5d1-63e395311f70 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:16.380837 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9704abdc-363c-43c4-a5d1-63e395311f70 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:16.381369 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9704abdc-363c-43c4-a5d1-63e395311f70 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:16.382262 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9704abdc-363c-43c4-a5d1-63e395311f70 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:16.382960 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9704abdc-363c-43c4-a5d1-63e395311f70 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:16.523794 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9704abdc-363c-43c4-a5d1-63e395311f70 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:16.532772 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9704abdc-363c-43c4-a5d1-63e395311f70 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.161604 Dec 27 14:27:16.533588 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 460/893] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:16 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:16.633456 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1c0f59bc-e684-49a3-b9e1-27115918352c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:16.634708 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1c0f59bc-e684-49a3-b9e1-27115918352c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:16.640674 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c0f59bc-e684-49a3-b9e1-27115918352c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:16.641124 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c0f59bc-e684-49a3-b9e1-27115918352c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:16.642508 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c0f59bc-e684-49a3-b9e1-27115918352c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:16.642941 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c0f59bc-e684-49a3-b9e1-27115918352c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:16.779083 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1c0f59bc-e684-49a3-b9e1-27115918352c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:16.787429 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1c0f59bc-e684-49a3-b9e1-27115918352c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:16.788973 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1c0f59bc-e684-49a3-b9e1-27115918352c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:16.790126 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1c0f59bc-e684-49a3-b9e1-27115918352c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1739 microversion: 2.20 time: 0.160917 Dec 27 14:27:16.790691 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 434/894] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:16 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:17.555337 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b9784c66-0850-4896-a18b-1891b9a0f646 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:17.556578 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b9784c66-0850-4896-a18b-1891b9a0f646 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:17.563292 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b9784c66-0850-4896-a18b-1891b9a0f646 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:17.564866 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b9784c66-0850-4896-a18b-1891b9a0f646 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:17.565694 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b9784c66-0850-4896-a18b-1891b9a0f646 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:17.566140 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b9784c66-0850-4896-a18b-1891b9a0f646 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:17.702615 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b9784c66-0850-4896-a18b-1891b9a0f646 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:17.711555 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b9784c66-0850-4896-a18b-1891b9a0f646 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.160946 Dec 27 14:27:17.722406 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 461/895] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:17 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:17.807862 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cb046555-bed5-451e-8f21-144c90eefcc2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:17.808584 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cb046555-bed5-451e-8f21-144c90eefcc2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:17.815485 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cb046555-bed5-451e-8f21-144c90eefcc2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:17.815968 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cb046555-bed5-451e-8f21-144c90eefcc2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:17.816768 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cb046555-bed5-451e-8f21-144c90eefcc2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:17.817207 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cb046555-bed5-451e-8f21-144c90eefcc2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:17.960920 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cb046555-bed5-451e-8f21-144c90eefcc2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:17.968828 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cb046555-bed5-451e-8f21-144c90eefcc2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:17.971282 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cb046555-bed5-451e-8f21-144c90eefcc2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:17.972467 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cb046555-bed5-451e-8f21-144c90eefcc2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1739 microversion: 2.20 time: 0.168427 Dec 27 14:27:17.973027 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 435/896] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:17 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:18.729030 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0185e1bd-33b7-48a1-99c9-8578222e5bc1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:18.730473 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0185e1bd-33b7-48a1-99c9-8578222e5bc1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:18.737513 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0185e1bd-33b7-48a1-99c9-8578222e5bc1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:18.738100 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0185e1bd-33b7-48a1-99c9-8578222e5bc1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:18.739008 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0185e1bd-33b7-48a1-99c9-8578222e5bc1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:18.739516 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0185e1bd-33b7-48a1-99c9-8578222e5bc1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:18.887044 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0185e1bd-33b7-48a1-99c9-8578222e5bc1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:18.895636 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0185e1bd-33b7-48a1-99c9-8578222e5bc1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.170672 Dec 27 14:27:18.906558 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 462/897] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:18 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:18.990468 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c84e729f-9415-49d4-a239-66f808678ec8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:18.991013 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c84e729f-9415-49d4-a239-66f808678ec8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:18.997467 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c84e729f-9415-49d4-a239-66f808678ec8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:18.997909 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c84e729f-9415-49d4-a239-66f808678ec8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:18.998681 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c84e729f-9415-49d4-a239-66f808678ec8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:18.999109 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c84e729f-9415-49d4-a239-66f808678ec8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:19.138108 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c84e729f-9415-49d4-a239-66f808678ec8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:19.154209 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c84e729f-9415-49d4-a239-66f808678ec8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:19.156025 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c84e729f-9415-49d4-a239-66f808678ec8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:19.157371 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c84e729f-9415-49d4-a239-66f808678ec8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1739 microversion: 2.20 time: 0.170535 Dec 27 14:27:19.158118 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 436/898] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:18 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:19.914798 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ac95bb13-1706-44fd-bfe7-a7bb8a05d4ad tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:19.915710 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ac95bb13-1706-44fd-bfe7-a7bb8a05d4ad tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:19.924640 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac95bb13-1706-44fd-bfe7-a7bb8a05d4ad tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:19.925173 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac95bb13-1706-44fd-bfe7-a7bb8a05d4ad tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:19.926100 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac95bb13-1706-44fd-bfe7-a7bb8a05d4ad tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:19.926641 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac95bb13-1706-44fd-bfe7-a7bb8a05d4ad tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:20.104997 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ac95bb13-1706-44fd-bfe7-a7bb8a05d4ad tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:20.113215 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ac95bb13-1706-44fd-bfe7-a7bb8a05d4ad tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.202745 Dec 27 14:27:20.114242 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 463/899] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:19 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:20.175607 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d97abd77-89d3-4616-8898-d9769ef967d8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:20.176218 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d97abd77-89d3-4616-8898-d9769ef967d8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:20.182912 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d97abd77-89d3-4616-8898-d9769ef967d8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:20.183390 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d97abd77-89d3-4616-8898-d9769ef967d8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:20.184346 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d97abd77-89d3-4616-8898-d9769ef967d8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:20.184991 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d97abd77-89d3-4616-8898-d9769ef967d8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:20.331979 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d97abd77-89d3-4616-8898-d9769ef967d8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:20.340860 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d97abd77-89d3-4616-8898-d9769ef967d8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:20.342356 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d97abd77-89d3-4616-8898-d9769ef967d8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:20.343597 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d97abd77-89d3-4616-8898-d9769ef967d8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1739 microversion: 2.20 time: 0.171865 Dec 27 14:27:20.358087 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 437/900] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:20 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:21.130215 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-36001709-4e27-4326-8d22-08cffc863491 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:21.130798 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-36001709-4e27-4326-8d22-08cffc863491 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:21.137168 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-36001709-4e27-4326-8d22-08cffc863491 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:21.137615 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-36001709-4e27-4326-8d22-08cffc863491 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:21.138417 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-36001709-4e27-4326-8d22-08cffc863491 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:21.138849 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-36001709-4e27-4326-8d22-08cffc863491 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:21.270304 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-36001709-4e27-4326-8d22-08cffc863491 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:21.277656 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-36001709-4e27-4326-8d22-08cffc863491 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.151212 Dec 27 14:27:21.278223 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 464/901] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:21 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:21.366321 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a26804f0-106d-4e80-8da0-651f0be4339d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:21.366949 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a26804f0-106d-4e80-8da0-651f0be4339d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:21.373168 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a26804f0-106d-4e80-8da0-651f0be4339d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:21.373610 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a26804f0-106d-4e80-8da0-651f0be4339d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:21.374378 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a26804f0-106d-4e80-8da0-651f0be4339d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:21.374806 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a26804f0-106d-4e80-8da0-651f0be4339d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:21.502115 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a26804f0-106d-4e80-8da0-651f0be4339d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:21.509692 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a26804f0-106d-4e80-8da0-651f0be4339d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:21.511163 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a26804f0-106d-4e80-8da0-651f0be4339d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:21.512328 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a26804f0-106d-4e80-8da0-651f0be4339d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1739 microversion: 2.20 time: 0.149668 Dec 27 14:27:21.512886 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 438/902] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:21 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:22.295396 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-74ea28ad-b09d-4a00-aeb0-33c20d41b00f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:22.296266 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-74ea28ad-b09d-4a00-aeb0-33c20d41b00f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:22.303194 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-74ea28ad-b09d-4a00-aeb0-33c20d41b00f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:22.303658 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-74ea28ad-b09d-4a00-aeb0-33c20d41b00f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:22.304475 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-74ea28ad-b09d-4a00-aeb0-33c20d41b00f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:22.304911 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-74ea28ad-b09d-4a00-aeb0-33c20d41b00f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:22.433064 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-74ea28ad-b09d-4a00-aeb0-33c20d41b00f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:22.440422 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-74ea28ad-b09d-4a00-aeb0-33c20d41b00f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.148674 Dec 27 14:27:22.440998 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 465/903] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:22 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:22.530508 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9f00c701-f543-478b-91b7-890b2efdeb71 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:22.531205 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9f00c701-f543-478b-91b7-890b2efdeb71 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:22.538095 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f00c701-f543-478b-91b7-890b2efdeb71 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:22.538539 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f00c701-f543-478b-91b7-890b2efdeb71 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:22.539318 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f00c701-f543-478b-91b7-890b2efdeb71 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:22.539749 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9f00c701-f543-478b-91b7-890b2efdeb71 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:22.745138 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9f00c701-f543-478b-91b7-890b2efdeb71 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:22.753400 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9f00c701-f543-478b-91b7-890b2efdeb71 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:22.754900 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9f00c701-f543-478b-91b7-890b2efdeb71 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:22.756077 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9f00c701-f543-478b-91b7-890b2efdeb71 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1721 microversion: 2.20 time: 0.229507 Dec 27 14:27:22.756640 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 439/904] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:22 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:23.457004 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d5b71051-d45c-4957-9fa2-0e50dfc2252b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:23.457612 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d5b71051-d45c-4957-9fa2-0e50dfc2252b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:23.463919 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d5b71051-d45c-4957-9fa2-0e50dfc2252b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:23.464370 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d5b71051-d45c-4957-9fa2-0e50dfc2252b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:23.465140 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d5b71051-d45c-4957-9fa2-0e50dfc2252b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:23.465573 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d5b71051-d45c-4957-9fa2-0e50dfc2252b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:23.591388 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d5b71051-d45c-4957-9fa2-0e50dfc2252b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:23.599023 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d5b71051-d45c-4957-9fa2-0e50dfc2252b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.145655 Dec 27 14:27:23.599584 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 466/905] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:23 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:23.774396 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-09d80d31-becf-4a08-b614-28652799412e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:23.775185 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-09d80d31-becf-4a08-b614-28652799412e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:23.783165 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-09d80d31-becf-4a08-b614-28652799412e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:23.783340 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-09d80d31-becf-4a08-b614-28652799412e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:23.784072 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-09d80d31-becf-4a08-b614-28652799412e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:23.784508 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-09d80d31-becf-4a08-b614-28652799412e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:23.918585 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-09d80d31-becf-4a08-b614-28652799412e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:23.926321 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-09d80d31-becf-4a08-b614-28652799412e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:23.927813 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-09d80d31-becf-4a08-b614-28652799412e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:23.928976 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-09d80d31-becf-4a08-b614-28652799412e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1721 microversion: 2.20 time: 0.158273 Dec 27 14:27:23.929534 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 440/906] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:23 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:24.616923 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1991d650-b46d-4523-bcdd-02712e136e0d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:24.617535 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1991d650-b46d-4523-bcdd-02712e136e0d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:24.623991 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1991d650-b46d-4523-bcdd-02712e136e0d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:24.624436 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1991d650-b46d-4523-bcdd-02712e136e0d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:24.625219 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1991d650-b46d-4523-bcdd-02712e136e0d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:24.625685 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1991d650-b46d-4523-bcdd-02712e136e0d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:24.760953 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1991d650-b46d-4523-bcdd-02712e136e0d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:24.768819 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1991d650-b46d-4523-bcdd-02712e136e0d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.155547 Dec 27 14:27:24.769396 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 467/907] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:24 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:24.854279 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-9f26572d-810a-494e-804b-a09bd9b35dfe req-a3765e4b-f490-4f28-8b21-4f14c61cf587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aad07b94-d83b-4d44-856c-80ac2e24b8b4", "name": "network-vif-unplugged", "status": "completed", "tag": "d8953eb3-d364-4473-98c5-e33562dcd960"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:27:24.855899 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:27:24.855899 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:27:24.863676 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-9f26572d-810a-494e-804b-a09bd9b35dfe req-a3765e4b-f490-4f28-8b21-4f14c61cf587 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:24.864149 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-9f26572d-810a-494e-804b-a09bd9b35dfe req-a3765e4b-f490-4f28-8b21-4f14c61cf587 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:24.875065 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-9f26572d-810a-494e-804b-a09bd9b35dfe req-a3765e4b-f490-4f28-8b21-4f14c61cf587 service nova] Creating event network-vif-unplugged:d8953eb3-d364-4473-98c5-e33562dcd960 for instance aad07b94-d83b-4d44-856c-80ac2e24b8b4 on hv-cinder-82301 Dec 27 14:27:24.880797 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-9f26572d-810a-494e-804b-a09bd9b35dfe req-a3765e4b-f490-4f28-8b21-4f14c61cf587 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030103 Dec 27 14:27:24.881442 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 441/908] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:27:24 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:27:24.946229 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e01cb1fd-2ee6-4c4a-a648-e26d893104ce tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:24.946870 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e01cb1fd-2ee6-4c4a-a648-e26d893104ce tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:24.957584 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e01cb1fd-2ee6-4c4a-a648-e26d893104ce tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:24.958042 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e01cb1fd-2ee6-4c4a-a648-e26d893104ce tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:24.958833 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e01cb1fd-2ee6-4c4a-a648-e26d893104ce tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:24.959271 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e01cb1fd-2ee6-4c4a-a648-e26d893104ce tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:25.101036 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e01cb1fd-2ee6-4c4a-a648-e26d893104ce tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:25.109920 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e01cb1fd-2ee6-4c4a-a648-e26d893104ce tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:25.111614 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e01cb1fd-2ee6-4c4a-a648-e26d893104ce tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:25.112939 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e01cb1fd-2ee6-4c4a-a648-e26d893104ce tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1724 microversion: 2.20 time: 0.170193 Dec 27 14:27:25.113336 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 468/909] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:24 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:25.131216 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e50018e0-adff-4006-b1a9-347c7590d528 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad23d095-e994-4238-8870-82f0f45c8251"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:27:25.132672 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e50018e0-adff-4006-b1a9-347c7590d528 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:25.138986 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e50018e0-adff-4006-b1a9-347c7590d528 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:25.139621 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e50018e0-adff-4006-b1a9-347c7590d528 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:25.140652 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e50018e0-adff-4006-b1a9-347c7590d528 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:25.141870 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e50018e0-adff-4006-b1a9-347c7590d528 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:25.411863 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e50018e0-adff-4006-b1a9-347c7590d528 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.284636 Dec 27 14:27:25.412486 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 442/910] 10.222.0.37 () {62 vars in 1363 bytes} [Mon Dec 27 14:27:25 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/os-volume_attachments => generated 188 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:27:25.518275 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9fd659ae-dfad-4d91-9593-74146de81b84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:27:25.518836 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9fd659ae-dfad-4d91-9593-74146de81b84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:25.524598 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9fd659ae-dfad-4d91-9593-74146de81b84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:25.525045 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9fd659ae-dfad-4d91-9593-74146de81b84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:25.525816 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9fd659ae-dfad-4d91-9593-74146de81b84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:25.526278 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9fd659ae-dfad-4d91-9593-74146de81b84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:25.701555 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9fd659ae-dfad-4d91-9593-74146de81b84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [893ac971-02d1-48c2-808b-5c20710aafad] AMQP server on 10.222.0.37:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 27 14:27:25.785690 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-991d4a78-73f1-4a42-9add-85c1b6010b64 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:25.786330 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-991d4a78-73f1-4a42-9add-85c1b6010b64 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:25.792921 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-991d4a78-73f1-4a42-9add-85c1b6010b64 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:25.793365 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-991d4a78-73f1-4a42-9add-85c1b6010b64 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:25.794141 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-991d4a78-73f1-4a42-9add-85c1b6010b64 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:25.794570 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-991d4a78-73f1-4a42-9add-85c1b6010b64 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:25.923099 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-991d4a78-73f1-4a42-9add-85c1b6010b64 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:25.930715 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-991d4a78-73f1-4a42-9add-85c1b6010b64 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.148625 Dec 27 14:27:25.931297 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 443/911] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:25 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:27:26.708854 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO oslo.messaging._drivers.impl_rabbit [None req-9fd659ae-dfad-4d91-9593-74146de81b84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [893ac971-02d1-48c2-808b-5c20710aafad] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 35110. Dec 27 14:27:26.711828 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9fd659ae-dfad-4d91-9593-74146de81b84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action" status: 202 len: 0 microversion: 2.20 time: 1.197950 Dec 27 14:27:26.712462 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 469/912] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:27:25 2021] POST /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/action => generated 0 bytes in 1199 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 27 14:27:26.720741 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f8b2e92c-4bb1-4f84-bf9b-a98220bb98ae tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:26.721341 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f8b2e92c-4bb1-4f84-bf9b-a98220bb98ae tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:26.727172 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f8b2e92c-4bb1-4f84-bf9b-a98220bb98ae tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:26.727618 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f8b2e92c-4bb1-4f84-bf9b-a98220bb98ae tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:26.728442 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f8b2e92c-4bb1-4f84-bf9b-a98220bb98ae tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:26.728872 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f8b2e92c-4bb1-4f84-bf9b-a98220bb98ae tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:26.864278 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f8b2e92c-4bb1-4f84-bf9b-a98220bb98ae tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:26.872767 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f8b2e92c-4bb1-4f84-bf9b-a98220bb98ae tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:26.874244 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f8b2e92c-4bb1-4f84-bf9b-a98220bb98ae tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:26.875405 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f8b2e92c-4bb1-4f84-bf9b-a98220bb98ae tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1750 microversion: 2.20 time: 0.158874 Dec 27 14:27:26.876135 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 444/913] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:26 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1750 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:26.947450 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f7198e90-c7a1-4fe1-a45b-05b9946dbd75 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:26.948081 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f7198e90-c7a1-4fe1-a45b-05b9946dbd75 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:26.954714 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f7198e90-c7a1-4fe1-a45b-05b9946dbd75 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:26.955164 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f7198e90-c7a1-4fe1-a45b-05b9946dbd75 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:26.955963 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f7198e90-c7a1-4fe1-a45b-05b9946dbd75 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:26.956396 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f7198e90-c7a1-4fe1-a45b-05b9946dbd75 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:27.091425 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f7198e90-c7a1-4fe1-a45b-05b9946dbd75 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:27.100865 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f7198e90-c7a1-4fe1-a45b-05b9946dbd75 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.156165 Dec 27 14:27:27.101176 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 470/914] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:26 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:27.893824 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-20cc6d98-e106-4e60-bc07-7e54c11f27eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:27.894975 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-20cc6d98-e106-4e60-bc07-7e54c11f27eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:27.901551 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20cc6d98-e106-4e60-bc07-7e54c11f27eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:27.902037 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20cc6d98-e106-4e60-bc07-7e54c11f27eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:27.902829 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20cc6d98-e106-4e60-bc07-7e54c11f27eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:27.903268 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-20cc6d98-e106-4e60-bc07-7e54c11f27eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:28.031244 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-20cc6d98-e106-4e60-bc07-7e54c11f27eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:28.039508 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-20cc6d98-e106-4e60-bc07-7e54c11f27eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:28.041083 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-20cc6d98-e106-4e60-bc07-7e54c11f27eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:28.042229 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-20cc6d98-e106-4e60-bc07-7e54c11f27eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1750 microversion: 2.20 time: 0.152202 Dec 27 14:27:28.042793 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 445/915] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:27 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1750 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:28.116699 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b76f93b2-ed62-41a6-9b21-f4b6ac90fc0d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:28.117305 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b76f93b2-ed62-41a6-9b21-f4b6ac90fc0d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:28.123534 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b76f93b2-ed62-41a6-9b21-f4b6ac90fc0d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:28.124023 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b76f93b2-ed62-41a6-9b21-f4b6ac90fc0d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:28.124798 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b76f93b2-ed62-41a6-9b21-f4b6ac90fc0d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:28.125232 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b76f93b2-ed62-41a6-9b21-f4b6ac90fc0d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:28.255988 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b76f93b2-ed62-41a6-9b21-f4b6ac90fc0d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:28.263212 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b76f93b2-ed62-41a6-9b21-f4b6ac90fc0d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.150079 Dec 27 14:27:28.263788 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 471/916] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:28 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:29.060376 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0788738d-64e2-4c72-8a53-e0b258edd8b1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:29.060966 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0788738d-64e2-4c72-8a53-e0b258edd8b1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:29.067280 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0788738d-64e2-4c72-8a53-e0b258edd8b1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:29.067728 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0788738d-64e2-4c72-8a53-e0b258edd8b1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:29.068538 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0788738d-64e2-4c72-8a53-e0b258edd8b1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:29.068979 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0788738d-64e2-4c72-8a53-e0b258edd8b1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:29.207952 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0788738d-64e2-4c72-8a53-e0b258edd8b1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:29.216082 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0788738d-64e2-4c72-8a53-e0b258edd8b1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:29.217563 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0788738d-64e2-4c72-8a53-e0b258edd8b1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:29.218696 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0788738d-64e2-4c72-8a53-e0b258edd8b1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1752 microversion: 2.20 time: 0.161975 Dec 27 14:27:29.219901 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 446/917] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:29 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:29.279984 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7ffd5295-70e2-4bb7-91ce-a2c06f83dc84 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:29.280632 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7ffd5295-70e2-4bb7-91ce-a2c06f83dc84 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:29.287594 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7ffd5295-70e2-4bb7-91ce-a2c06f83dc84 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:29.288098 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7ffd5295-70e2-4bb7-91ce-a2c06f83dc84 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:29.288889 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7ffd5295-70e2-4bb7-91ce-a2c06f83dc84 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:29.289330 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7ffd5295-70e2-4bb7-91ce-a2c06f83dc84 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:29.417908 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-7ffd5295-70e2-4bb7-91ce-a2c06f83dc84 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:29.425804 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7ffd5295-70e2-4bb7-91ce-a2c06f83dc84 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.149643 Dec 27 14:27:29.426368 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 472/918] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:29 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:30.238205 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7afe77a0-969a-4b5e-9c68-cb0d84f6a960 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:30.238808 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7afe77a0-969a-4b5e-9c68-cb0d84f6a960 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:30.244720 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7afe77a0-969a-4b5e-9c68-cb0d84f6a960 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:30.245161 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7afe77a0-969a-4b5e-9c68-cb0d84f6a960 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:30.245929 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7afe77a0-969a-4b5e-9c68-cb0d84f6a960 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:30.246359 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7afe77a0-969a-4b5e-9c68-cb0d84f6a960 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:30.372772 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7afe77a0-969a-4b5e-9c68-cb0d84f6a960 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:30.381561 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7afe77a0-969a-4b5e-9c68-cb0d84f6a960 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:30.383112 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7afe77a0-969a-4b5e-9c68-cb0d84f6a960 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:30.384286 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7afe77a0-969a-4b5e-9c68-cb0d84f6a960 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1752 microversion: 2.20 time: 0.151760 Dec 27 14:27:30.385050 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 447/919] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:30 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:30.442598 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c05d0170-c51f-413f-8739-9fb57e5ff0c2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:30.443205 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c05d0170-c51f-413f-8739-9fb57e5ff0c2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:30.449578 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c05d0170-c51f-413f-8739-9fb57e5ff0c2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:30.450024 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c05d0170-c51f-413f-8739-9fb57e5ff0c2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:30.450805 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c05d0170-c51f-413f-8739-9fb57e5ff0c2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:30.451228 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c05d0170-c51f-413f-8739-9fb57e5ff0c2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:30.590877 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c05d0170-c51f-413f-8739-9fb57e5ff0c2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:30.598733 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c05d0170-c51f-413f-8739-9fb57e5ff0c2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.159908 Dec 27 14:27:30.599295 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 473/920] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:30 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:31.402669 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3e7a7222-23d3-4032-b4fb-6914dd7ec140 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:31.403258 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3e7a7222-23d3-4032-b4fb-6914dd7ec140 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:31.409747 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e7a7222-23d3-4032-b4fb-6914dd7ec140 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:31.410523 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e7a7222-23d3-4032-b4fb-6914dd7ec140 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:31.411327 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e7a7222-23d3-4032-b4fb-6914dd7ec140 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:31.411815 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e7a7222-23d3-4032-b4fb-6914dd7ec140 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:31.615625 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5e438168-7f3a-46ff-9eef-2c05576c7d86 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:31.616340 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5e438168-7f3a-46ff-9eef-2c05576c7d86 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:31.623123 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5e438168-7f3a-46ff-9eef-2c05576c7d86 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:31.623568 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5e438168-7f3a-46ff-9eef-2c05576c7d86 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:31.624411 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5e438168-7f3a-46ff-9eef-2c05576c7d86 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:31.624848 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5e438168-7f3a-46ff-9eef-2c05576c7d86 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:31.778186 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5e438168-7f3a-46ff-9eef-2c05576c7d86 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:31.786592 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5e438168-7f3a-46ff-9eef-2c05576c7d86 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.174732 Dec 27 14:27:31.787437 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 474/921] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:31 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:31.829545 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3e7a7222-23d3-4032-b4fb-6914dd7ec140 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:31.838138 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3e7a7222-23d3-4032-b4fb-6914dd7ec140 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:31.839653 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3e7a7222-23d3-4032-b4fb-6914dd7ec140 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:31.840844 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3e7a7222-23d3-4032-b4fb-6914dd7ec140 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1752 microversion: 2.20 time: 0.442069 Dec 27 14:27:31.841456 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 448/922] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:31 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1752 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:32.803900 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9f615863-6d80-4727-969c-ac5e6047ce2f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:32.804524 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9f615863-6d80-4727-969c-ac5e6047ce2f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:32.817062 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9f615863-6d80-4727-969c-ac5e6047ce2f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:32.817943 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9f615863-6d80-4727-969c-ac5e6047ce2f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:32.818909 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9f615863-6d80-4727-969c-ac5e6047ce2f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:32.819505 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9f615863-6d80-4727-969c-ac5e6047ce2f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:32.861053 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-71094181-faeb-4b7e-9032-351d1aa69ff5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:32.863525 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-71094181-faeb-4b7e-9032-351d1aa69ff5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:32.880989 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71094181-faeb-4b7e-9032-351d1aa69ff5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:32.883465 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71094181-faeb-4b7e-9032-351d1aa69ff5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:32.884702 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71094181-faeb-4b7e-9032-351d1aa69ff5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:32.895888 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71094181-faeb-4b7e-9032-351d1aa69ff5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:33.046331 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9f615863-6d80-4727-969c-ac5e6047ce2f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:33.055527 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9f615863-6d80-4727-969c-ac5e6047ce2f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.255235 Dec 27 14:27:33.056558 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 475/923] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:32 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:33.092733 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-71094181-faeb-4b7e-9032-351d1aa69ff5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:33.102011 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-71094181-faeb-4b7e-9032-351d1aa69ff5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:33.103533 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-71094181-faeb-4b7e-9032-351d1aa69ff5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:33.104739 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-71094181-faeb-4b7e-9032-351d1aa69ff5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.249386 Dec 27 14:27:33.105297 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 449/924] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:32 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:34.073539 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1ccb7f8c-18b6-4251-b706-5c8de28213a2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:34.074272 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1ccb7f8c-18b6-4251-b706-5c8de28213a2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:34.081817 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1ccb7f8c-18b6-4251-b706-5c8de28213a2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:34.082454 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1ccb7f8c-18b6-4251-b706-5c8de28213a2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:34.083267 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1ccb7f8c-18b6-4251-b706-5c8de28213a2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:34.083690 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1ccb7f8c-18b6-4251-b706-5c8de28213a2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:34.125763 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2633a081-ee14-4a16-bb3c-1b8da813a5b9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:34.125763 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2633a081-ee14-4a16-bb3c-1b8da813a5b9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:34.131008 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2633a081-ee14-4a16-bb3c-1b8da813a5b9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:34.131404 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2633a081-ee14-4a16-bb3c-1b8da813a5b9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:34.132240 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2633a081-ee14-4a16-bb3c-1b8da813a5b9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:34.132681 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2633a081-ee14-4a16-bb3c-1b8da813a5b9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:34.252258 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1ccb7f8c-18b6-4251-b706-5c8de28213a2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:34.260822 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1ccb7f8c-18b6-4251-b706-5c8de28213a2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.191381 Dec 27 14:27:34.261416 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 476/925] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:34 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:34.280898 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2633a081-ee14-4a16-bb3c-1b8da813a5b9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:34.289154 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2633a081-ee14-4a16-bb3c-1b8da813a5b9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:34.290649 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2633a081-ee14-4a16-bb3c-1b8da813a5b9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:34.291799 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2633a081-ee14-4a16-bb3c-1b8da813a5b9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.172184 Dec 27 14:27:34.292383 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 450/926] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:34 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:27:35.277650 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-541ef387-78ae-4729-9a5d-0b5654c6e686 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:35.278247 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-541ef387-78ae-4729-9a5d-0b5654c6e686 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:35.286080 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-541ef387-78ae-4729-9a5d-0b5654c6e686 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:35.286532 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-541ef387-78ae-4729-9a5d-0b5654c6e686 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:35.287324 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-541ef387-78ae-4729-9a5d-0b5654c6e686 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:35.287755 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-541ef387-78ae-4729-9a5d-0b5654c6e686 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:35.310614 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-772290eb-75e4-4386-b06e-c15c3599be02 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:35.311264 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-772290eb-75e4-4386-b06e-c15c3599be02 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:35.318020 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-772290eb-75e4-4386-b06e-c15c3599be02 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:35.318454 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-772290eb-75e4-4386-b06e-c15c3599be02 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:35.319239 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-772290eb-75e4-4386-b06e-c15c3599be02 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:35.319808 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-772290eb-75e4-4386-b06e-c15c3599be02 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:35.438274 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-541ef387-78ae-4729-9a5d-0b5654c6e686 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:35.445702 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-541ef387-78ae-4729-9a5d-0b5654c6e686 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.171743 Dec 27 14:27:35.446265 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 477/927] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:35 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:35.469438 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-772290eb-75e4-4386-b06e-c15c3599be02 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:35.477914 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-772290eb-75e4-4386-b06e-c15c3599be02 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:35.479524 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-772290eb-75e4-4386-b06e-c15c3599be02 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:35.480712 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-772290eb-75e4-4386-b06e-c15c3599be02 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.174105 Dec 27 14:27:35.481271 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 451/928] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:35 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:27:36.464093 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-85d427eb-06e2-405c-b45e-3e6908538251 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:36.465344 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-85d427eb-06e2-405c-b45e-3e6908538251 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:36.472437 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-85d427eb-06e2-405c-b45e-3e6908538251 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:36.472888 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-85d427eb-06e2-405c-b45e-3e6908538251 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:36.473693 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-85d427eb-06e2-405c-b45e-3e6908538251 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:36.474129 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-85d427eb-06e2-405c-b45e-3e6908538251 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:36.498300 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-695e1b6b-c572-458b-94de-2377f8b29907 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:36.499097 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-695e1b6b-c572-458b-94de-2377f8b29907 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:36.508481 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-695e1b6b-c572-458b-94de-2377f8b29907 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:36.509453 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-695e1b6b-c572-458b-94de-2377f8b29907 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:36.510508 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-695e1b6b-c572-458b-94de-2377f8b29907 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:36.511043 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-695e1b6b-c572-458b-94de-2377f8b29907 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:36.615050 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-85d427eb-06e2-405c-b45e-3e6908538251 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:36.622933 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-85d427eb-06e2-405c-b45e-3e6908538251 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.162606 Dec 27 14:27:36.635986 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 478/929] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:36 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:36.675537 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-695e1b6b-c572-458b-94de-2377f8b29907 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:36.683778 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-695e1b6b-c572-458b-94de-2377f8b29907 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:36.685556 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-695e1b6b-c572-458b-94de-2377f8b29907 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:36.686897 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-695e1b6b-c572-458b-94de-2377f8b29907 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.192343 Dec 27 14:27:36.688383 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 452/930] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:36 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:27:37.640190 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e3deb5d7-92fb-42e0-b452-08cb6d83e982 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:37.640932 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e3deb5d7-92fb-42e0-b452-08cb6d83e982 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:37.647494 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e3deb5d7-92fb-42e0-b452-08cb6d83e982 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:37.648065 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e3deb5d7-92fb-42e0-b452-08cb6d83e982 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:37.648927 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e3deb5d7-92fb-42e0-b452-08cb6d83e982 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:37.649438 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e3deb5d7-92fb-42e0-b452-08cb6d83e982 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:37.705680 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d3e73812-6603-470e-b00e-24031d5aec42 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:37.706957 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d3e73812-6603-470e-b00e-24031d5aec42 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:37.714026 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3e73812-6603-470e-b00e-24031d5aec42 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:37.714836 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3e73812-6603-470e-b00e-24031d5aec42 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:37.715907 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3e73812-6603-470e-b00e-24031d5aec42 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:37.716508 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d3e73812-6603-470e-b00e-24031d5aec42 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:37.811882 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e3deb5d7-92fb-42e0-b452-08cb6d83e982 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:37.820413 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e3deb5d7-92fb-42e0-b452-08cb6d83e982 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.184247 Dec 27 14:27:37.821199 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 479/931] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:37 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:37.923908 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d3e73812-6603-470e-b00e-24031d5aec42 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:37.932080 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d3e73812-6603-470e-b00e-24031d5aec42 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:37.933569 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d3e73812-6603-470e-b00e-24031d5aec42 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:37.934722 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d3e73812-6603-470e-b00e-24031d5aec42 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.233532 Dec 27 14:27:37.935279 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 453/932] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:37 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:38.839098 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e6fb09f9-3470-4f46-baca-9e7ecc3cfbc3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:38.840420 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e6fb09f9-3470-4f46-baca-9e7ecc3cfbc3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:38.847809 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6fb09f9-3470-4f46-baca-9e7ecc3cfbc3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:38.848605 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6fb09f9-3470-4f46-baca-9e7ecc3cfbc3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:38.849737 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6fb09f9-3470-4f46-baca-9e7ecc3cfbc3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:38.850423 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e6fb09f9-3470-4f46-baca-9e7ecc3cfbc3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:38.973008 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-16c3c8d1-eafd-4ac9-b2a4-a76897076f43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:38.989477 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-16c3c8d1-eafd-4ac9-b2a4-a76897076f43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:38.995690 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16c3c8d1-eafd-4ac9-b2a4-a76897076f43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:39.008500 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16c3c8d1-eafd-4ac9-b2a4-a76897076f43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:39.009918 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16c3c8d1-eafd-4ac9-b2a4-a76897076f43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:39.010416 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16c3c8d1-eafd-4ac9-b2a4-a76897076f43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:39.093148 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e6fb09f9-3470-4f46-baca-9e7ecc3cfbc3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:39.107964 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e6fb09f9-3470-4f46-baca-9e7ecc3cfbc3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.273949 Dec 27 14:27:39.109090 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 480/933] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:38 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:39.313913 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-16c3c8d1-eafd-4ac9-b2a4-a76897076f43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:39.324727 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-16c3c8d1-eafd-4ac9-b2a4-a76897076f43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:39.326617 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-16c3c8d1-eafd-4ac9-b2a4-a76897076f43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:39.329003 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-16c3c8d1-eafd-4ac9-b2a4-a76897076f43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.377179 Dec 27 14:27:39.345813 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 454/934] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:38 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:40.131802 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5b987650-fd03-4434-96c5-0c64e9deaba8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:40.132491 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5b987650-fd03-4434-96c5-0c64e9deaba8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:40.139356 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5b987650-fd03-4434-96c5-0c64e9deaba8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:40.140089 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5b987650-fd03-4434-96c5-0c64e9deaba8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:40.141220 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5b987650-fd03-4434-96c5-0c64e9deaba8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:40.141977 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5b987650-fd03-4434-96c5-0c64e9deaba8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:40.342694 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5b987650-fd03-4434-96c5-0c64e9deaba8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:40.348346 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e262897b-8761-4416-b465-e295aac367d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:40.349610 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e262897b-8761-4416-b465-e295aac367d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:40.363287 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5b987650-fd03-4434-96c5-0c64e9deaba8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.237643 Dec 27 14:27:40.364639 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 481/935] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:40 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:40.365764 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e262897b-8761-4416-b465-e295aac367d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:40.366216 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e262897b-8761-4416-b465-e295aac367d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:40.367230 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e262897b-8761-4416-b465-e295aac367d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:40.367671 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e262897b-8761-4416-b465-e295aac367d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:40.579706 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e262897b-8761-4416-b465-e295aac367d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:40.588401 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e262897b-8761-4416-b465-e295aac367d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:40.589875 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e262897b-8761-4416-b465-e295aac367d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:40.591213 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e262897b-8761-4416-b465-e295aac367d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.247393 Dec 27 14:27:40.594187 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 455/936] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:40 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:41.381701 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9d8117dd-3155-44e7-97fb-3d2d2fab2c54 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:41.383156 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9d8117dd-3155-44e7-97fb-3d2d2fab2c54 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:41.394870 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9d8117dd-3155-44e7-97fb-3d2d2fab2c54 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:41.395663 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9d8117dd-3155-44e7-97fb-3d2d2fab2c54 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:41.397305 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9d8117dd-3155-44e7-97fb-3d2d2fab2c54 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:41.399522 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9d8117dd-3155-44e7-97fb-3d2d2fab2c54 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:41.611023 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f0eaedc9-f173-49e1-ab0f-627c11e85d44 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:41.611664 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f0eaedc9-f173-49e1-ab0f-627c11e85d44 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:41.619354 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f0eaedc9-f173-49e1-ab0f-627c11e85d44 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:41.619808 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f0eaedc9-f173-49e1-ab0f-627c11e85d44 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:41.620637 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f0eaedc9-f173-49e1-ab0f-627c11e85d44 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:41.621262 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f0eaedc9-f173-49e1-ab0f-627c11e85d44 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:41.826720 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9d8117dd-3155-44e7-97fb-3d2d2fab2c54 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:41.835418 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9d8117dd-3155-44e7-97fb-3d2d2fab2c54 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.457753 Dec 27 14:27:41.841459 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 482/937] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:41 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:41.911783 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f0eaedc9-f173-49e1-ab0f-627c11e85d44 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:41.920925 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f0eaedc9-f173-49e1-ab0f-627c11e85d44 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:41.924008 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f0eaedc9-f173-49e1-ab0f-627c11e85d44 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:41.925420 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f0eaedc9-f173-49e1-ab0f-627c11e85d44 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.319432 Dec 27 14:27:41.926732 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 456/938] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:41 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:27:42.858983 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-be6fd28b-528a-4322-8b58-547491a7ba6f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:42.860720 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-be6fd28b-528a-4322-8b58-547491a7ba6f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:42.867297 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-be6fd28b-528a-4322-8b58-547491a7ba6f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:42.867751 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-be6fd28b-528a-4322-8b58-547491a7ba6f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:42.868885 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-be6fd28b-528a-4322-8b58-547491a7ba6f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:42.869357 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-be6fd28b-528a-4322-8b58-547491a7ba6f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:42.957680 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a3bac22f-1496-4eef-a2fc-ae78cf237939 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:42.965289 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a3bac22f-1496-4eef-a2fc-ae78cf237939 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:42.984904 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a3bac22f-1496-4eef-a2fc-ae78cf237939 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:42.985361 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a3bac22f-1496-4eef-a2fc-ae78cf237939 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:42.986166 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a3bac22f-1496-4eef-a2fc-ae78cf237939 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:42.986791 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a3bac22f-1496-4eef-a2fc-ae78cf237939 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:43.142892 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-be6fd28b-528a-4322-8b58-547491a7ba6f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:43.163737 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-be6fd28b-528a-4322-8b58-547491a7ba6f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.308850 Dec 27 14:27:43.172155 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 483/939] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:42 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:43.215417 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a3bac22f-1496-4eef-a2fc-ae78cf237939 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:43.228927 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a3bac22f-1496-4eef-a2fc-ae78cf237939 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:43.230765 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a3bac22f-1496-4eef-a2fc-ae78cf237939 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:43.231957 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a3bac22f-1496-4eef-a2fc-ae78cf237939 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.291256 Dec 27 14:27:43.232521 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 457/940] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:42 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:27:44.188440 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-806e8029-b1f8-45d2-8c81-9610f164a585 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:44.190436 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-806e8029-b1f8-45d2-8c81-9610f164a585 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:44.213251 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-806e8029-b1f8-45d2-8c81-9610f164a585 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:44.217219 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-806e8029-b1f8-45d2-8c81-9610f164a585 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:44.221616 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-806e8029-b1f8-45d2-8c81-9610f164a585 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:44.225150 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-806e8029-b1f8-45d2-8c81-9610f164a585 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:44.251520 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f62ee42a-82c4-40d1-8c82-b288c865a627 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:44.252604 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f62ee42a-82c4-40d1-8c82-b288c865a627 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:44.264063 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f62ee42a-82c4-40d1-8c82-b288c865a627 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:44.269206 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f62ee42a-82c4-40d1-8c82-b288c865a627 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:44.270072 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f62ee42a-82c4-40d1-8c82-b288c865a627 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:44.270518 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f62ee42a-82c4-40d1-8c82-b288c865a627 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:44.462606 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-806e8029-b1f8-45d2-8c81-9610f164a585 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:44.471369 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-806e8029-b1f8-45d2-8c81-9610f164a585 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.289865 Dec 27 14:27:44.472432 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 484/941] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:44 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:44.776937 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f62ee42a-82c4-40d1-8c82-b288c865a627 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:44.786187 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f62ee42a-82c4-40d1-8c82-b288c865a627 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:44.788147 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f62ee42a-82c4-40d1-8c82-b288c865a627 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:44.789488 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f62ee42a-82c4-40d1-8c82-b288c865a627 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.542900 Dec 27 14:27:44.790604 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 458/942] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:44 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:27:45.488774 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b1f38515-114d-4f1b-aeec-86bc2eda4002 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:45.489705 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b1f38515-114d-4f1b-aeec-86bc2eda4002 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:45.497371 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b1f38515-114d-4f1b-aeec-86bc2eda4002 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:45.497947 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b1f38515-114d-4f1b-aeec-86bc2eda4002 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:45.498855 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b1f38515-114d-4f1b-aeec-86bc2eda4002 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:45.499417 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b1f38515-114d-4f1b-aeec-86bc2eda4002 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:45.646097 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b1f38515-114d-4f1b-aeec-86bc2eda4002 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:45.656673 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b1f38515-114d-4f1b-aeec-86bc2eda4002 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.171352 Dec 27 14:27:45.657871 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 485/943] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:45 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:45.808395 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fc169446-5639-483d-9289-8e716085e4f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:45.808925 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fc169446-5639-483d-9289-8e716085e4f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:45.815527 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc169446-5639-483d-9289-8e716085e4f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:45.816301 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc169446-5639-483d-9289-8e716085e4f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:45.817267 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc169446-5639-483d-9289-8e716085e4f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:45.817872 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc169446-5639-483d-9289-8e716085e4f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:46.079115 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fc169446-5639-483d-9289-8e716085e4f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:46.091490 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fc169446-5639-483d-9289-8e716085e4f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:46.094946 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fc169446-5639-483d-9289-8e716085e4f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:46.099225 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fc169446-5639-483d-9289-8e716085e4f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.294568 Dec 27 14:27:46.100500 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 459/944] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:45 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:46.674282 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-eb45505a-f1a9-4e9e-afbf-86cf4c135596 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:46.675058 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-eb45505a-f1a9-4e9e-afbf-86cf4c135596 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:46.685233 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb45505a-f1a9-4e9e-afbf-86cf4c135596 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:46.685939 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb45505a-f1a9-4e9e-afbf-86cf4c135596 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:46.686902 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb45505a-f1a9-4e9e-afbf-86cf4c135596 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:46.688069 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-eb45505a-f1a9-4e9e-afbf-86cf4c135596 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:47.117602 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fd9e56e9-edaa-4fa7-8635-cbf6b0f648d2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:47.118751 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fd9e56e9-edaa-4fa7-8635-cbf6b0f648d2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:47.133840 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd9e56e9-edaa-4fa7-8635-cbf6b0f648d2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:47.134441 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd9e56e9-edaa-4fa7-8635-cbf6b0f648d2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:47.135364 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd9e56e9-edaa-4fa7-8635-cbf6b0f648d2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:47.135943 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd9e56e9-edaa-4fa7-8635-cbf6b0f648d2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:47.259816 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-eb45505a-f1a9-4e9e-afbf-86cf4c135596 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:47.275733 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-eb45505a-f1a9-4e9e-afbf-86cf4c135596 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1678 microversion: 2.1 time: 0.606088 Dec 27 14:27:47.278347 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 486/945] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:46 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1678 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:47.311441 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fd9e56e9-edaa-4fa7-8635-cbf6b0f648d2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:47.335543 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fd9e56e9-edaa-4fa7-8635-cbf6b0f648d2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:47.341840 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fd9e56e9-edaa-4fa7-8635-cbf6b0f648d2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:47.346563 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fd9e56e9-edaa-4fa7-8635-cbf6b0f648d2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.232698 Dec 27 14:27:47.360495 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 460/946] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:47 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:48.295564 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-79f8ad1d-5370-4f82-9259-639c74b8f7ca tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:48.296223 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-79f8ad1d-5370-4f82-9259-639c74b8f7ca tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:48.307015 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-79f8ad1d-5370-4f82-9259-639c74b8f7ca tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:48.307485 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-79f8ad1d-5370-4f82-9259-639c74b8f7ca tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:48.308330 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-79f8ad1d-5370-4f82-9259-639c74b8f7ca tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:48.315026 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-79f8ad1d-5370-4f82-9259-639c74b8f7ca tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:48.370362 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-45bf3605-7cb8-41ed-b506-0d1b83269eab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:48.372120 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-45bf3605-7cb8-41ed-b506-0d1b83269eab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:48.383193 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45bf3605-7cb8-41ed-b506-0d1b83269eab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:48.383964 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45bf3605-7cb8-41ed-b506-0d1b83269eab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:48.384963 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45bf3605-7cb8-41ed-b506-0d1b83269eab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:48.385566 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-45bf3605-7cb8-41ed-b506-0d1b83269eab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:48.552015 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-45bf3605-7cb8-41ed-b506-0d1b83269eab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:48.560848 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-45bf3605-7cb8-41ed-b506-0d1b83269eab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:48.563602 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-45bf3605-7cb8-41ed-b506-0d1b83269eab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:48.564980 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-45bf3605-7cb8-41ed-b506-0d1b83269eab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.198326 Dec 27 14:27:48.566017 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 461/947] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:48 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:27:48.571122 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-79f8ad1d-5370-4f82-9259-639c74b8f7ca tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:48.579893 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-79f8ad1d-5370-4f82-9259-639c74b8f7ca tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1655 microversion: 2.1 time: 0.289026 Dec 27 14:27:48.580390 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 487/948] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:48 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1655 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:48.595888 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-303a159b-8c4a-4e8f-b47e-bead156c5574 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:27:48.611299 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-303a159b-8c4a-4e8f-b47e-bead156c5574 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:48.612884 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-303a159b-8c4a-4e8f-b47e-bead156c5574 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:48.657563 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-303a159b-8c4a-4e8f-b47e-bead156c5574 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Going to try to start instance {{(pid=116104) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 27 14:27:48.709812 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-303a159b-8c4a-4e8f-b47e-bead156c5574 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action" status: 202 len: 0 microversion: 2.1 time: 0.117304 Dec 27 14:27:48.710512 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 462/949] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:27:48 2021] POST /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:27:48.729399 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e1cb5e10-0888-43d1-a200-fdba53d886dc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:48.730294 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e1cb5e10-0888-43d1-a200-fdba53d886dc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:48.737883 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1cb5e10-0888-43d1-a200-fdba53d886dc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:48.738900 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1cb5e10-0888-43d1-a200-fdba53d886dc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:48.739913 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1cb5e10-0888-43d1-a200-fdba53d886dc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:48.740551 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1cb5e10-0888-43d1-a200-fdba53d886dc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:48.925486 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-429747f1-47b7-408f-8c07-61347e293722 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Action: 'create', calling method: .version_select at 0x7f80284554c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-200701949"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:27:48.940031 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-429747f1-47b7-408f-8c07-61347e293722 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Getting quotas for project 05268adb4a234195999f6992b93b3175. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:27:48.944314 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-429747f1-47b7-408f-8c07-61347e293722 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Getting quotas for user 529e9e9288714c6297be093f1a5e8163 and project 05268adb4a234195999f6992b93b3175. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:27:48.957228 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: ERROR oslo.messaging._drivers.impl_rabbit [None req-429747f1-47b7-408f-8c07-61347e293722 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [9622a880-ad72-4257-bbfd-039a01499d57] AMQP server on 10.222.0.37:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 27 14:27:48.980702 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e1cb5e10-0888-43d1-a200-fdba53d886dc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:48.988284 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e1cb5e10-0888-43d1-a200-fdba53d886dc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1664 microversion: 2.1 time: 0.263104 Dec 27 14:27:48.988871 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 463/950] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:48 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1664 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:49.582842 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e365b08e-3696-47b5-8738-91ac8b0389f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:49.583528 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e365b08e-3696-47b5-8738-91ac8b0389f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:49.590068 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e365b08e-3696-47b5-8738-91ac8b0389f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:49.590518 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e365b08e-3696-47b5-8738-91ac8b0389f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:49.591303 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e365b08e-3696-47b5-8738-91ac8b0389f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:49.591749 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e365b08e-3696-47b5-8738-91ac8b0389f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:49.733676 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e365b08e-3696-47b5-8738-91ac8b0389f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:49.742053 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e365b08e-3696-47b5-8738-91ac8b0389f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:49.743540 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e365b08e-3696-47b5-8738-91ac8b0389f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:49.744709 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e365b08e-3696-47b5-8738-91ac8b0389f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.165558 Dec 27 14:27:49.745272 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 464/951] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:49 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:27:49.965003 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO oslo.messaging._drivers.impl_rabbit [None req-429747f1-47b7-408f-8c07-61347e293722 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [9622a880-ad72-4257-bbfd-039a01499d57] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 35354. Dec 27 14:27:50.006010 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1e816567-d0f4-47d8-b084-4c237ea90507 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:50.006618 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1e816567-d0f4-47d8-b084-4c237ea90507 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:50.013519 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e816567-d0f4-47d8-b084-4c237ea90507 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:50.013968 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e816567-d0f4-47d8-b084-4c237ea90507 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:50.014752 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e816567-d0f4-47d8-b084-4c237ea90507 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:50.015190 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1e816567-d0f4-47d8-b084-4c237ea90507 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:50.165060 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-429747f1-47b7-408f-8c07-61347e293722 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Getting quotas for project 05268adb4a234195999f6992b93b3175. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:27:50.180113 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-429747f1-47b7-408f-8c07-61347e293722 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Getting quotas for user 529e9e9288714c6297be093f1a5e8163 and project 05268adb4a234195999f6992b93b3175. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:27:50.198358 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-429747f1-47b7-408f-8c07-61347e293722 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 1.493711 Dec 27 14:27:50.204445 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 488/952] 10.222.0.37 () {60 vars in 1157 bytes} [Mon Dec 27 14:27:48 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:50.217196 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1e816567-d0f4-47d8-b084-4c237ea90507 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:50.226529 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1e816567-d0f4-47d8-b084-4c237ea90507 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1664 microversion: 2.1 time: 0.224033 Dec 27 14:27:50.227489 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 465/953] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:50 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1664 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:27:50.763731 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8d99ac07-6c9e-4e0f-bf96-e00cb70025d3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:50.764502 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8d99ac07-6c9e-4e0f-bf96-e00cb70025d3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:50.771163 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8d99ac07-6c9e-4e0f-bf96-e00cb70025d3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:50.771613 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8d99ac07-6c9e-4e0f-bf96-e00cb70025d3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:50.772628 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8d99ac07-6c9e-4e0f-bf96-e00cb70025d3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:50.773229 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8d99ac07-6c9e-4e0f-bf96-e00cb70025d3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:50.952582 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8d99ac07-6c9e-4e0f-bf96-e00cb70025d3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:50.962447 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8d99ac07-6c9e-4e0f-bf96-e00cb70025d3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:50.964629 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8d99ac07-6c9e-4e0f-bf96-e00cb70025d3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:50.966475 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8d99ac07-6c9e-4e0f-bf96-e00cb70025d3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.207421 Dec 27 14:27:50.979296 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 489/954] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:50 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:51.245330 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5d0b1277-b362-4fa3-8e33-307b232b27ab tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:51.245919 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5d0b1277-b362-4fa3-8e33-307b232b27ab tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:51.253431 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5d0b1277-b362-4fa3-8e33-307b232b27ab tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:51.253897 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5d0b1277-b362-4fa3-8e33-307b232b27ab tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:51.254681 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5d0b1277-b362-4fa3-8e33-307b232b27ab tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:51.255115 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5d0b1277-b362-4fa3-8e33-307b232b27ab tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:51.420611 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5d0b1277-b362-4fa3-8e33-307b232b27ab tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:51.431466 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5d0b1277-b362-4fa3-8e33-307b232b27ab tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1668 microversion: 2.1 time: 0.189739 Dec 27 14:27:51.432435 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 466/955] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:27:51 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1668 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:27:52.106824 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c841f3e5-1ef5-4270-88e8-33548fc541ff tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:52.107439 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c841f3e5-1ef5-4270-88e8-33548fc541ff tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:52.117027 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c841f3e5-1ef5-4270-88e8-33548fc541ff tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:52.117509 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c841f3e5-1ef5-4270-88e8-33548fc541ff tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:52.118344 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c841f3e5-1ef5-4270-88e8-33548fc541ff tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:52.118783 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c841f3e5-1ef5-4270-88e8-33548fc541ff tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:52.265998 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c841f3e5-1ef5-4270-88e8-33548fc541ff tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:52.274660 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c841f3e5-1ef5-4270-88e8-33548fc541ff tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:52.276273 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c841f3e5-1ef5-4270-88e8-33548fc541ff tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:52.277524 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c841f3e5-1ef5-4270-88e8-33548fc541ff tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.295981 Dec 27 14:27:52.278329 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 490/956] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:51 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:53.295886 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4be2ef3e-d7dd-4c9a-90b4-ab78a2327dba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:53.297242 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4be2ef3e-d7dd-4c9a-90b4-ab78a2327dba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:53.303712 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4be2ef3e-d7dd-4c9a-90b4-ab78a2327dba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:53.304262 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4be2ef3e-d7dd-4c9a-90b4-ab78a2327dba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:53.305038 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4be2ef3e-d7dd-4c9a-90b4-ab78a2327dba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:53.305468 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4be2ef3e-d7dd-4c9a-90b4-ab78a2327dba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:53.446780 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4be2ef3e-d7dd-4c9a-90b4-ab78a2327dba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:53.455705 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4be2ef3e-d7dd-4c9a-90b4-ab78a2327dba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:53.457227 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4be2ef3e-d7dd-4c9a-90b4-ab78a2327dba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:53.458376 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4be2ef3e-d7dd-4c9a-90b4-ab78a2327dba tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.166227 Dec 27 14:27:53.458938 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 467/957] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:53 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:27:54.478995 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9ce848c0-9f4c-4201-b518-efe896f0807a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:54.479594 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9ce848c0-9f4c-4201-b518-efe896f0807a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:54.488033 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ce848c0-9f4c-4201-b518-efe896f0807a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:54.488744 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ce848c0-9f4c-4201-b518-efe896f0807a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:54.489531 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ce848c0-9f4c-4201-b518-efe896f0807a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:54.489968 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ce848c0-9f4c-4201-b518-efe896f0807a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:54.621345 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9ce848c0-9f4c-4201-b518-efe896f0807a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:54.630595 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9ce848c0-9f4c-4201-b518-efe896f0807a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:54.632107 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9ce848c0-9f4c-4201-b518-efe896f0807a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:54.633248 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9ce848c0-9f4c-4201-b518-efe896f0807a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.159734 Dec 27 14:27:54.633799 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 491/958] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:54 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:27:55.652097 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d0eeb320-34e1-4bd1-8164-56e938e2984d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:55.652691 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d0eeb320-34e1-4bd1-8164-56e938e2984d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:55.659726 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0eeb320-34e1-4bd1-8164-56e938e2984d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:55.660201 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0eeb320-34e1-4bd1-8164-56e938e2984d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:55.660990 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0eeb320-34e1-4bd1-8164-56e938e2984d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:55.661420 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d0eeb320-34e1-4bd1-8164-56e938e2984d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:55.793497 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d0eeb320-34e1-4bd1-8164-56e938e2984d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:55.802050 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d0eeb320-34e1-4bd1-8164-56e938e2984d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:55.803547 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d0eeb320-34e1-4bd1-8164-56e938e2984d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:55.804723 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d0eeb320-34e1-4bd1-8164-56e938e2984d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.157535 Dec 27 14:27:55.805280 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 468/959] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:55 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:56.822325 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b50d70a2-d992-4bda-a53c-961f8f567e57 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:56.822935 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b50d70a2-d992-4bda-a53c-961f8f567e57 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:56.830389 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b50d70a2-d992-4bda-a53c-961f8f567e57 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:56.830852 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b50d70a2-d992-4bda-a53c-961f8f567e57 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:56.831671 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b50d70a2-d992-4bda-a53c-961f8f567e57 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:56.832147 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b50d70a2-d992-4bda-a53c-961f8f567e57 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:56.970528 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b50d70a2-d992-4bda-a53c-961f8f567e57 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:56.988069 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b50d70a2-d992-4bda-a53c-961f8f567e57 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:56.989568 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b50d70a2-d992-4bda-a53c-961f8f567e57 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:56.990735 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b50d70a2-d992-4bda-a53c-961f8f567e57 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.172148 Dec 27 14:27:56.991527 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 492/960] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:56 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:58.010098 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ba548598-4546-4007-a094-d851970c0250 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:58.010704 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ba548598-4546-4007-a094-d851970c0250 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:58.018109 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ba548598-4546-4007-a094-d851970c0250 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:58.018553 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ba548598-4546-4007-a094-d851970c0250 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:58.019364 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ba548598-4546-4007-a094-d851970c0250 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:58.019794 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ba548598-4546-4007-a094-d851970c0250 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:58.158159 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ba548598-4546-4007-a094-d851970c0250 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:58.166462 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ba548598-4546-4007-a094-d851970c0250 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:58.167989 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ba548598-4546-4007-a094-d851970c0250 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:58.169148 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ba548598-4546-4007-a094-d851970c0250 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.162793 Dec 27 14:27:58.169713 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 469/961] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:58 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:27:58.998751 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-437684f9-1390-4623-a3c7-cd78e226e7b6 req-d08daa88-01c5-4f87-b062-c285a96dec83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aad07b94-d83b-4d44-856c-80ac2e24b8b4", "name": "network-vif-plugged", "status": "completed", "tag": "d8953eb3-d364-4473-98c5-e33562dcd960"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:27:59.000304 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:27:59.000304 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:27:59.008081 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-437684f9-1390-4623-a3c7-cd78e226e7b6 req-d08daa88-01c5-4f87-b062-c285a96dec83 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:59.008632 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-437684f9-1390-4623-a3c7-cd78e226e7b6 req-d08daa88-01c5-4f87-b062-c285a96dec83 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:59.021345 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-437684f9-1390-4623-a3c7-cd78e226e7b6 req-d08daa88-01c5-4f87-b062-c285a96dec83 service nova] Creating event network-vif-plugged:d8953eb3-d364-4473-98c5-e33562dcd960 for instance aad07b94-d83b-4d44-856c-80ac2e24b8b4 on hv-cinder-82301 Dec 27 14:27:59.026554 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-437684f9-1390-4623-a3c7-cd78e226e7b6 req-d08daa88-01c5-4f87-b062-c285a96dec83 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031392 Dec 27 14:27:59.027162 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 493/962] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:27:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:27:59.188155 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e2b73a15-1edb-4729-947d-15aa2fba0b0f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:27:59.188766 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e2b73a15-1edb-4729-947d-15aa2fba0b0f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:27:59.195168 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2b73a15-1edb-4729-947d-15aa2fba0b0f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:59.195621 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2b73a15-1edb-4729-947d-15aa2fba0b0f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:59.196436 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2b73a15-1edb-4729-947d-15aa2fba0b0f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:27:59.196871 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2b73a15-1edb-4729-947d-15aa2fba0b0f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:27:59.332183 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e2b73a15-1edb-4729-947d-15aa2fba0b0f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:59.340622 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e2b73a15-1edb-4729-947d-15aa2fba0b0f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:59.342131 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e2b73a15-1edb-4729-947d-15aa2fba0b0f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:27:59.343269 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e2b73a15-1edb-4729-947d-15aa2fba0b0f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.159400 Dec 27 14:27:59.343870 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 470/963] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:27:59 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:28:00.362785 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9b93bfcd-4edc-4490-98f5-dd38e351c725 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:00.363480 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9b93bfcd-4edc-4490-98f5-dd38e351c725 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:00.369600 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b93bfcd-4edc-4490-98f5-dd38e351c725 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:00.370035 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b93bfcd-4edc-4490-98f5-dd38e351c725 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:00.370804 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b93bfcd-4edc-4490-98f5-dd38e351c725 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:00.371240 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b93bfcd-4edc-4490-98f5-dd38e351c725 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:00.506812 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9b93bfcd-4edc-4490-98f5-dd38e351c725 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:00.515538 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9b93bfcd-4edc-4490-98f5-dd38e351c725 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:00.517787 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9b93bfcd-4edc-4490-98f5-dd38e351c725 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:00.518957 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9b93bfcd-4edc-4490-98f5-dd38e351c725 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.161296 Dec 27 14:28:00.519516 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 494/964] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:28:00 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:28:01.538896 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-18b8e141-6791-4da0-a44f-1ed21181e72e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:01.539598 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-18b8e141-6791-4da0-a44f-1ed21181e72e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:01.546945 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18b8e141-6791-4da0-a44f-1ed21181e72e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:01.547430 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18b8e141-6791-4da0-a44f-1ed21181e72e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:01.548789 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18b8e141-6791-4da0-a44f-1ed21181e72e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:01.549227 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18b8e141-6791-4da0-a44f-1ed21181e72e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:01.686160 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-18b8e141-6791-4da0-a44f-1ed21181e72e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:01.695253 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-18b8e141-6791-4da0-a44f-1ed21181e72e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:01.696782 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-18b8e141-6791-4da0-a44f-1ed21181e72e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:01.697943 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-18b8e141-6791-4da0-a44f-1ed21181e72e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1808 microversion: 2.20 time: 0.163328 Dec 27 14:28:01.698506 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 471/965] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:28:01 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:28:02.716496 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3184075c-1718-4f6c-a5a3-3e6e4e5e5441 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:02.717098 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3184075c-1718-4f6c-a5a3-3e6e4e5e5441 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:02.724173 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3184075c-1718-4f6c-a5a3-3e6e4e5e5441 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:02.724622 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3184075c-1718-4f6c-a5a3-3e6e4e5e5441 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:02.725397 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3184075c-1718-4f6c-a5a3-3e6e4e5e5441 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:02.725826 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3184075c-1718-4f6c-a5a3-3e6e4e5e5441 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:02.865257 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3184075c-1718-4f6c-a5a3-3e6e4e5e5441 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:02.873562 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3184075c-1718-4f6c-a5a3-3e6e4e5e5441 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:02.875065 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3184075c-1718-4f6c-a5a3-3e6e4e5e5441 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:02.876885 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3184075c-1718-4f6c-a5a3-3e6e4e5e5441 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1795 microversion: 2.20 time: 0.164117 Dec 27 14:28:02.877433 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 495/966] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:28:02 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1795 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:28:14.900447 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6832312f-ae1b-44a7-aaa0-6ec5e2e2da3d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-369789928", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-200701949", "security_groups": [{"name": "tempest-secgroup-smoke-474312789"}], "block_device_mapping_v2": [{"uuid": "15251d35-1fca-425b-ad65-449916ad3caa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dfbd514e-e372-4721-aac1-a9c7fb2e81c2"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:28:15.016557 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-6832312f-ae1b-44a7-aaa0-6ec5e2e2da3d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] validate_networks() for [('dfbd514e-e372-4721-aac1-a9c7fb2e81c2', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 27 14:28:15.466864 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-6832312f-ae1b-44a7-aaa0-6ec5e2e2da3d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 27 14:28:15.467287 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-6832312f-ae1b-44a7-aaa0-6ec5e2e2da3d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 27 14:28:15.467759 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-6832312f-ae1b-44a7-aaa0-6ec5e2e2da3d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 27 14:28:15.468194 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-6832312f-ae1b-44a7-aaa0-6ec5e2e2da3d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 27 14:28:15.468601 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-6832312f-ae1b-44a7-aaa0-6ec5e2e2da3d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 27 14:28:15.477943 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6832312f-ae1b-44a7-aaa0-6ec5e2e2da3d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:15.478385 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6832312f-ae1b-44a7-aaa0-6ec5e2e2da3d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:15.479186 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6832312f-ae1b-44a7-aaa0-6ec5e2e2da3d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:15.479618 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6832312f-ae1b-44a7-aaa0-6ec5e2e2da3d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:15.495984 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-6832312f-ae1b-44a7-aaa0-6ec5e2e2da3d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Getting quotas for project 05268adb4a234195999f6992b93b3175. Resources: {'cores', 'ram', 'instances'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:28:15.499776 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-6832312f-ae1b-44a7-aaa0-6ec5e2e2da3d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Getting quotas for user 529e9e9288714c6297be093f1a5e8163 and project 05268adb4a234195999f6992b93b3175. Resources: {'cores', 'ram', 'instances'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:28:15.553170 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6832312f-ae1b-44a7-aaa0-6ec5e2e2da3d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 27 14:28:15.555280 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6832312f-ae1b-44a7-aaa0-6ec5e2e2da3d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='15251d35-1fca-425b-ad65-449916ad3caa',volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 27 14:28:15.674098 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6832312f-ae1b-44a7-aaa0-6ec5e2e2da3d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.777139 Dec 27 14:28:15.674735 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 472/967] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Dec 27 14:28:14 2021] POST /compute/v2.1/servers => generated 405 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 27 14:28:15.684206 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f7c8c4e7-7294-4085-a8a5-95abd46f39d0 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:15.684806 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f7c8c4e7-7294-4085-a8a5-95abd46f39d0 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:15.736660 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f7c8c4e7-7294-4085-a8a5-95abd46f39d0 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:15.743210 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f7c8c4e7-7294-4085-a8a5-95abd46f39d0 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d" status: 200 len: 1093 microversion: 2.1 time: 0.062584 Dec 27 14:28:15.743783 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 496/968] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:28:15 2021] GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d => generated 1093 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:28:16.761749 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a5463db2-8966-467c-ad58-972341508773 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:16.762464 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a5463db2-8966-467c-ad58-972341508773 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:16.769992 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a5463db2-8966-467c-ad58-972341508773 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:16.770653 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a5463db2-8966-467c-ad58-972341508773 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:16.771519 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a5463db2-8966-467c-ad58-972341508773 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:16.772062 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a5463db2-8966-467c-ad58-972341508773 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:16.852553 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a5463db2-8966-467c-ad58-972341508773 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:16.859899 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a5463db2-8966-467c-ad58-972341508773 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d" status: 200 len: 1209 microversion: 2.1 time: 0.102964 Dec 27 14:28:16.860470 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 473/969] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:28:16 2021] GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d => generated 1209 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:28:17.876585 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-821beb62-803e-49b2-9fa8-5272dd250f01 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:17.877576 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-821beb62-803e-49b2-9fa8-5272dd250f01 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:17.885357 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-821beb62-803e-49b2-9fa8-5272dd250f01 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:17.885821 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-821beb62-803e-49b2-9fa8-5272dd250f01 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:17.886628 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-821beb62-803e-49b2-9fa8-5272dd250f01 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:17.887316 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-821beb62-803e-49b2-9fa8-5272dd250f01 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:18.046815 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-821beb62-803e-49b2-9fa8-5272dd250f01 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:18.057706 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-821beb62-803e-49b2-9fa8-5272dd250f01 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d" status: 200 len: 1264 microversion: 2.1 time: 0.184629 Dec 27 14:28:18.058301 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 497/970] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:28:17 2021] GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:28:18.064801 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-6fda0f66-f86c-4e2f-b0a5-92290d13f635 req-311e4947-ea34-4a3a-9e18-25ddf7c0d1ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d", "tag": "5b8c6947-5cbc-4988-981c-34cec1bb4240"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:28:18.068478 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:28:18.068478 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:28:18.076123 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-6fda0f66-f86c-4e2f-b0a5-92290d13f635 req-311e4947-ea34-4a3a-9e18-25ddf7c0d1ba service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:18.076490 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-6fda0f66-f86c-4e2f-b0a5-92290d13f635 req-311e4947-ea34-4a3a-9e18-25ddf7c0d1ba service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:18.090166 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-6fda0f66-f86c-4e2f-b0a5-92290d13f635 req-311e4947-ea34-4a3a-9e18-25ddf7c0d1ba service nova] Creating event network-changed:5b8c6947-5cbc-4988-981c-34cec1bb4240 for instance 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d on hv-cinder-82301 Dec 27 14:28:18.097063 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-6fda0f66-f86c-4e2f-b0a5-92290d13f635 req-311e4947-ea34-4a3a-9e18-25ddf7c0d1ba service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117062 Dec 27 14:28:18.097971 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 474/971] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:28:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:28:19.012688 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0e2c7394-10f1-42fa-8c06-e7877fdad72b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1627542527"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:28:19.013226 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0e2c7394-10f1-42fa-8c06-e7877fdad72b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:19.019590 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0e2c7394-10f1-42fa-8c06-e7877fdad72b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:19.020079 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0e2c7394-10f1-42fa-8c06-e7877fdad72b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:19.020852 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0e2c7394-10f1-42fa-8c06-e7877fdad72b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:19.021286 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0e2c7394-10f1-42fa-8c06-e7877fdad72b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:19.075329 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-71b43961-46e5-4444-be5f-98b0b98f0f40 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:19.076049 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-71b43961-46e5-4444-be5f-98b0b98f0f40 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:19.082711 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71b43961-46e5-4444-be5f-98b0b98f0f40 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:19.083164 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71b43961-46e5-4444-be5f-98b0b98f0f40 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:19.083989 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71b43961-46e5-4444-be5f-98b0b98f0f40 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:19.084413 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71b43961-46e5-4444-be5f-98b0b98f0f40 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:19.153351 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.network.security_group_api [None req-0e2c7394-10f1-42fa-8c06-e7877fdad72b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Removing security group ae997008-005f-48b5-9677-e7995653da8a from port 7e953f6b-a948-41fc-94f1-b04996e676ac Dec 27 14:28:19.223913 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-71b43961-46e5-4444-be5f-98b0b98f0f40 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:19.231080 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-71b43961-46e5-4444-be5f-98b0b98f0f40 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d" status: 200 len: 1264 microversion: 2.1 time: 0.160295 Dec 27 14:28:19.231656 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 475/972] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:28:19 2021] GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:28:19.486530 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0e2c7394-10f1-42fa-8c06-e7877fdad72b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "POST /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40/action" status: 202 len: 0 microversion: 2.1 time: 0.574393 Dec 27 14:28:19.489424 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 498/973] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:28:18 2021] POST /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40/action => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:28:19.587052 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-a94d1b2a-8259-4f37-bc65-20d47c973080 req-ad51bcd3-56f0-40d0-b16d-2ee3759bc19a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ff5786-5d44-438e-bb0a-f3fd05d83e40", "tag": "7e953f6b-a948-41fc-94f1-b04996e676ac"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:28:19.588708 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:28:19.588708 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:28:19.597732 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-a94d1b2a-8259-4f37-bc65-20d47c973080 req-ad51bcd3-56f0-40d0-b16d-2ee3759bc19a service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:19.598487 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-a94d1b2a-8259-4f37-bc65-20d47c973080 req-ad51bcd3-56f0-40d0-b16d-2ee3759bc19a service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:19.618728 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-a94d1b2a-8259-4f37-bc65-20d47c973080 req-ad51bcd3-56f0-40d0-b16d-2ee3759bc19a service nova] Creating event network-changed:7e953f6b-a948-41fc-94f1-b04996e676ac for instance 29ff5786-5d44-438e-bb0a-f3fd05d83e40 on hv-cinder-82301 Dec 27 14:28:19.624764 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-a94d1b2a-8259-4f37-bc65-20d47c973080 req-ad51bcd3-56f0-40d0-b16d-2ee3759bc19a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132508 Dec 27 14:28:19.625894 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 476/974] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:28:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:28:20.249449 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-25efb994-dfd5-4c7f-8996-97c6f2bdfa21 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:20.251516 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-25efb994-dfd5-4c7f-8996-97c6f2bdfa21 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:20.259459 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-25efb994-dfd5-4c7f-8996-97c6f2bdfa21 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:20.259943 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-25efb994-dfd5-4c7f-8996-97c6f2bdfa21 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:20.260900 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-25efb994-dfd5-4c7f-8996-97c6f2bdfa21 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:20.261342 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-25efb994-dfd5-4c7f-8996-97c6f2bdfa21 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:20.515172 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-25efb994-dfd5-4c7f-8996-97c6f2bdfa21 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:20.524209 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-25efb994-dfd5-4c7f-8996-97c6f2bdfa21 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d" status: 200 len: 1264 microversion: 2.1 time: 0.279066 Dec 27 14:28:20.528011 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 499/975] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:28:20 2021] GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d => generated 1264 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:28:20.717356 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d728bf04-6bc0-4e2d-920c-a29bf146ed20 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:20.717930 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d728bf04-6bc0-4e2d-920c-a29bf146ed20 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:20.724063 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d728bf04-6bc0-4e2d-920c-a29bf146ed20 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:20.724506 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d728bf04-6bc0-4e2d-920c-a29bf146ed20 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:20.725278 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d728bf04-6bc0-4e2d-920c-a29bf146ed20 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:20.725706 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d728bf04-6bc0-4e2d-920c-a29bf146ed20 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:20.804073 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-d728bf04-6bc0-4e2d-920c-a29bf146ed20 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lazy-loading 'services' on Instance uuid 29ff5786-5d44-438e-bb0a-f3fd05d83e40 {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:28:20.872651 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d728bf04-6bc0-4e2d-920c-a29bf146ed20 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "DELETE /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40/os-volume_attachments/efc5223a-03d9-4e17-b346-fd2029ef2406" status: 202 len: 0 microversion: 2.1 time: 0.159594 Dec 27 14:28:20.873305 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 477/976] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Dec 27 14:28:20 2021] DELETE /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40/os-volume_attachments/efc5223a-03d9-4e17-b346-fd2029ef2406 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:28:20.881563 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5b177c06-050b-46df-ac39-2bda874c2f5b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:20.882614 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5b177c06-050b-46df-ac39-2bda874c2f5b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:20.888800 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5b177c06-050b-46df-ac39-2bda874c2f5b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:20.889260 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5b177c06-050b-46df-ac39-2bda874c2f5b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:20.890265 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5b177c06-050b-46df-ac39-2bda874c2f5b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:20.892276 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5b177c06-050b-46df-ac39-2bda874c2f5b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:20.922815 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5b177c06-050b-46df-ac39-2bda874c2f5b tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044932 Dec 27 14:28:20.923434 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 500/977] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:28:20 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:28:21.542292 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2685aae2-efd3-4e02-83b3-d7fcfe1d9b54 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:21.542995 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2685aae2-efd3-4e02-83b3-d7fcfe1d9b54 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:21.549990 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2685aae2-efd3-4e02-83b3-d7fcfe1d9b54 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:21.550454 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2685aae2-efd3-4e02-83b3-d7fcfe1d9b54 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:21.551262 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2685aae2-efd3-4e02-83b3-d7fcfe1d9b54 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:21.551705 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2685aae2-efd3-4e02-83b3-d7fcfe1d9b54 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:21.659657 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-b9ac923e-212e-4db2-8a8f-38a65692b26f req-5696f61d-7965-4af3-bb9c-40f1d87427cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ff5786-5d44-438e-bb0a-f3fd05d83e40", "tag": "7e953f6b-a948-41fc-94f1-b04996e676ac"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:28:21.662264 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:28:21.662264 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:28:21.682895 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-b9ac923e-212e-4db2-8a8f-38a65692b26f req-5696f61d-7965-4af3-bb9c-40f1d87427cc service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:21.688001 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-b9ac923e-212e-4db2-8a8f-38a65692b26f req-5696f61d-7965-4af3-bb9c-40f1d87427cc service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:21.701313 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-b9ac923e-212e-4db2-8a8f-38a65692b26f req-5696f61d-7965-4af3-bb9c-40f1d87427cc service nova] Creating event network-changed:7e953f6b-a948-41fc-94f1-b04996e676ac for instance 29ff5786-5d44-438e-bb0a-f3fd05d83e40 on hv-cinder-82301 Dec 27 14:28:21.702610 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2685aae2-efd3-4e02-83b3-d7fcfe1d9b54 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:21.708540 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-b9ac923e-212e-4db2-8a8f-38a65692b26f req-5696f61d-7965-4af3-bb9c-40f1d87427cc service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054239 Dec 27 14:28:21.709695 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 501/978] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:28:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:28:21.715990 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2685aae2-efd3-4e02-83b3-d7fcfe1d9b54 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d" status: 200 len: 1264 microversion: 2.1 time: 0.177561 Dec 27 14:28:21.724216 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 478/979] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:28:21 2021] GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:28:21.935281 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-bd1a3014-53d3-4beb-b34e-53e756ca2e3f tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:21.936304 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-bd1a3014-53d3-4beb-b34e-53e756ca2e3f tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:21.942448 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bd1a3014-53d3-4beb-b34e-53e756ca2e3f tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:21.942908 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bd1a3014-53d3-4beb-b34e-53e756ca2e3f tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:21.943689 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bd1a3014-53d3-4beb-b34e-53e756ca2e3f tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:21.944236 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bd1a3014-53d3-4beb-b34e-53e756ca2e3f tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:21.972679 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-bd1a3014-53d3-4beb-b34e-53e756ca2e3f tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041488 Dec 27 14:28:21.973419 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 502/980] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:28:21 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 27 14:28:21.983031 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b4db8b56-85cb-4f02-8123-e927929f918d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:21.983533 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b4db8b56-85cb-4f02-8123-e927929f918d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:21.990834 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4db8b56-85cb-4f02-8123-e927929f918d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:21.991286 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4db8b56-85cb-4f02-8123-e927929f918d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:21.992115 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4db8b56-85cb-4f02-8123-e927929f918d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:21.992554 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b4db8b56-85cb-4f02-8123-e927929f918d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:22.065669 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-b4db8b56-85cb-4f02-8123-e927929f918d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] HTTP exception thrown: Instance 29ff5786-5d44-438e-bb0a-f3fd05d83e40 is not attached to volume efc5223a-03d9-4e17-b346-fd2029ef2406 Dec 27 14:28:22.066277 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b4db8b56-85cb-4f02-8123-e927929f918d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Returning 404 to user: Instance 29ff5786-5d44-438e-bb0a-f3fd05d83e40 is not attached to volume efc5223a-03d9-4e17-b346-fd2029ef2406 {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:28:22.067114 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b4db8b56-85cb-4f02-8123-e927929f918d tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "DELETE /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40/os-volume_attachments/efc5223a-03d9-4e17-b346-fd2029ef2406" status: 404 len: 154 microversion: 2.1 time: 0.088141 Dec 27 14:28:22.067672 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 479/981] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Dec 27 14:28:21 2021] DELETE /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40/os-volume_attachments/efc5223a-03d9-4e17-b346-fd2029ef2406 => generated 154 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:28:22.732425 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-dd5c3a5a-f1da-47b9-b9bb-4cc51ab509b5 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:22.733034 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-dd5c3a5a-f1da-47b9-b9bb-4cc51ab509b5 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:22.740020 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd5c3a5a-f1da-47b9-b9bb-4cc51ab509b5 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:22.740469 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd5c3a5a-f1da-47b9-b9bb-4cc51ab509b5 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:22.741241 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd5c3a5a-f1da-47b9-b9bb-4cc51ab509b5 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:22.741671 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dd5c3a5a-f1da-47b9-b9bb-4cc51ab509b5 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:22.874200 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-dd5c3a5a-f1da-47b9-b9bb-4cc51ab509b5 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:22.881855 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-dd5c3a5a-f1da-47b9-b9bb-4cc51ab509b5 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d" status: 200 len: 1264 microversion: 2.1 time: 0.153097 Dec 27 14:28:22.882417 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 503/982] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:28:22 2021] GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:28:23.202216 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e057b31d-8c87-44cd-8167-8d38aafe158e tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:23.202719 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e057b31d-8c87-44cd-8167-8d38aafe158e tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:23.209211 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e057b31d-8c87-44cd-8167-8d38aafe158e tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:23.209661 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e057b31d-8c87-44cd-8167-8d38aafe158e tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:23.210445 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e057b31d-8c87-44cd-8167-8d38aafe158e tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:23.210880 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e057b31d-8c87-44cd-8167-8d38aafe158e tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:23.234645 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e057b31d-8c87-44cd-8167-8d38aafe158e tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 27 14:28:23.307910 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e057b31d-8c87-44cd-8167-8d38aafe158e tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "DELETE /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 204 len: 0 microversion: 2.1 time: 0.109023 Dec 27 14:28:23.308518 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 480/983] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Dec 27 14:28:23 2021] DELETE /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 27 14:28:23.316885 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-da33fbd6-5844-4e12-bdf8-d81fa78633cc tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:23.317494 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-da33fbd6-5844-4e12-bdf8-d81fa78633cc tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:23.323507 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-da33fbd6-5844-4e12-bdf8-d81fa78633cc tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:23.324001 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-da33fbd6-5844-4e12-bdf8-d81fa78633cc tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:23.324795 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-da33fbd6-5844-4e12-bdf8-d81fa78633cc tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:23.325237 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-da33fbd6-5844-4e12-bdf8-d81fa78633cc tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:23.460529 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-da33fbd6-5844-4e12-bdf8-d81fa78633cc tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:23.467740 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-da33fbd6-5844-4e12-bdf8-d81fa78633cc tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1555 microversion: 2.1 time: 0.154838 Dec 27 14:28:23.468334 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 504/984] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:28:23 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:28:23.899096 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8cb9a5e3-22a0-4b40-8e46-5c1299d60dbf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:23.899800 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8cb9a5e3-22a0-4b40-8e46-5c1299d60dbf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:23.905997 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8cb9a5e3-22a0-4b40-8e46-5c1299d60dbf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:23.906452 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8cb9a5e3-22a0-4b40-8e46-5c1299d60dbf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:23.907278 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8cb9a5e3-22a0-4b40-8e46-5c1299d60dbf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:23.908275 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8cb9a5e3-22a0-4b40-8e46-5c1299d60dbf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:24.039476 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8cb9a5e3-22a0-4b40-8e46-5c1299d60dbf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:24.046750 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8cb9a5e3-22a0-4b40-8e46-5c1299d60dbf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d" status: 200 len: 1264 microversion: 2.1 time: 0.151652 Dec 27 14:28:24.047308 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 481/985] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:28:23 2021] GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:28:24.487238 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-263b1213-9ab3-426d-918d-ff720b04d586 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:24.488000 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-263b1213-9ab3-426d-918d-ff720b04d586 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:24.494498 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-263b1213-9ab3-426d-918d-ff720b04d586 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:24.495031 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-263b1213-9ab3-426d-918d-ff720b04d586 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:24.495928 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-263b1213-9ab3-426d-918d-ff720b04d586 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:24.496379 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-263b1213-9ab3-426d-918d-ff720b04d586 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:24.629395 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-263b1213-9ab3-426d-918d-ff720b04d586 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42c3f50b20424a43a00425b9c779a39b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca837abe525d4bf89957e0a02b5d06d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:24.637555 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-263b1213-9ab3-426d-918d-ff720b04d586 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 200 len: 1555 microversion: 2.1 time: 0.154922 Dec 27 14:28:24.638892 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 505/986] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:28:24 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:28:24.706801 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-aeedc569-441e-4bb8-8b88-f052e8824a1e req-e1327d59-600e-422d-9f96-2bb2f200241b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ff5786-5d44-438e-bb0a-f3fd05d83e40", "name": "network-vif-deleted", "tag": "7e953f6b-a948-41fc-94f1-b04996e676ac"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:28:24.708562 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:28:24.708562 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:28:24.715779 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-aeedc569-441e-4bb8-8b88-f052e8824a1e req-e1327d59-600e-422d-9f96-2bb2f200241b service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:24.716259 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-aeedc569-441e-4bb8-8b88-f052e8824a1e req-e1327d59-600e-422d-9f96-2bb2f200241b service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:24.727703 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-aeedc569-441e-4bb8-8b88-f052e8824a1e req-e1327d59-600e-422d-9f96-2bb2f200241b service nova] Creating event network-vif-deleted:7e953f6b-a948-41fc-94f1-b04996e676ac for instance 29ff5786-5d44-438e-bb0a-f3fd05d83e40 on hv-cinder-82301 Dec 27 14:28:24.732777 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-aeedc569-441e-4bb8-8b88-f052e8824a1e req-e1327d59-600e-422d-9f96-2bb2f200241b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029598 Dec 27 14:28:24.733364 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 482/987] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:28:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:28:25.063472 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d56d5874-8106-4359-a02f-6bf906072b41 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:25.064038 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d56d5874-8106-4359-a02f-6bf906072b41 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:25.070035 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d56d5874-8106-4359-a02f-6bf906072b41 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:25.070489 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d56d5874-8106-4359-a02f-6bf906072b41 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:25.071272 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d56d5874-8106-4359-a02f-6bf906072b41 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:25.071709 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d56d5874-8106-4359-a02f-6bf906072b41 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:25.224275 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d56d5874-8106-4359-a02f-6bf906072b41 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:25.232912 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d56d5874-8106-4359-a02f-6bf906072b41 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d" status: 200 len: 1264 microversion: 2.1 time: 0.173138 Dec 27 14:28:25.233676 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 506/988] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:28:25 2021] GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:28:25.655827 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-534ce079-0a55-4512-99ee-78f333d39060 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:25.656544 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-534ce079-0a55-4512-99ee-78f333d39060 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] [instance: 29ff5786-5d44-438e-bb0a-f3fd05d83e40] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:25.663218 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-534ce079-0a55-4512-99ee-78f333d39060 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:25.663659 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-534ce079-0a55-4512-99ee-78f333d39060 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:25.664479 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-534ce079-0a55-4512-99ee-78f333d39060 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:25.664910 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-534ce079-0a55-4512-99ee-78f333d39060 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:25.677954 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-534ce079-0a55-4512-99ee-78f333d39060 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] HTTP exception thrown: Instance 29ff5786-5d44-438e-bb0a-f3fd05d83e40 could not be found. Dec 27 14:28:25.678518 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-534ce079-0a55-4512-99ee-78f333d39060 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Returning 404 to user: Instance 29ff5786-5d44-438e-bb0a-f3fd05d83e40 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:28:25.679334 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-534ce079-0a55-4512-99ee-78f333d39060 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40" status: 404 len: 111 microversion: 2.1 time: 0.027786 Dec 27 14:28:25.680175 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 483/989] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:28:25 2021] GET /compute/v2.1/servers/29ff5786-5d44-438e-bb0a-f3fd05d83e40 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:28:25.688151 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-56ecbddd-8797-417d-9157-679bcfd7b576 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] Calling method '.version_select at 0x7f802840eee0>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:25.708760 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-56ecbddd-8797-417d-9157-679bcfd7b576 tempest-TestMinimumBasicScenario-2080977504 tempest-TestMinimumBasicScenario-2080977504-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1327463049" status: 202 len: 0 microversion: 2.1 time: 0.024124 Dec 27 14:28:25.709322 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 507/990] 10.222.0.37 () {58 vars in 1271 bytes} [Mon Dec 27 14:28:25 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1327463049 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:28:26.250106 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e22eb8d8-ec55-4b23-8c7a-d94b86640919 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:26.250864 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e22eb8d8-ec55-4b23-8c7a-d94b86640919 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:26.257505 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e22eb8d8-ec55-4b23-8c7a-d94b86640919 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:26.261046 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e22eb8d8-ec55-4b23-8c7a-d94b86640919 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:26.262246 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e22eb8d8-ec55-4b23-8c7a-d94b86640919 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:26.262918 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e22eb8d8-ec55-4b23-8c7a-d94b86640919 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:26.402954 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e22eb8d8-ec55-4b23-8c7a-d94b86640919 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:26.411582 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e22eb8d8-ec55-4b23-8c7a-d94b86640919 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d" status: 200 len: 1264 microversion: 2.1 time: 0.165495 Dec 27 14:28:26.412181 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 484/991] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:28:26 2021] GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:28:27.429145 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-904fdff6-c95e-4012-86df-c2a5ea817a7a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:27.429763 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-904fdff6-c95e-4012-86df-c2a5ea817a7a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:27.437635 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-904fdff6-c95e-4012-86df-c2a5ea817a7a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:27.438092 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-904fdff6-c95e-4012-86df-c2a5ea817a7a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:27.439518 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-904fdff6-c95e-4012-86df-c2a5ea817a7a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:27.440106 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-904fdff6-c95e-4012-86df-c2a5ea817a7a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:27.717095 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-904fdff6-c95e-4012-86df-c2a5ea817a7a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:27.724877 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-904fdff6-c95e-4012-86df-c2a5ea817a7a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d" status: 200 len: 1264 microversion: 2.1 time: 0.299407 Dec 27 14:28:27.725751 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 508/992] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:28:27 2021] GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d => generated 1264 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:28:28.742182 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d9672280-6c11-42f4-92a6-616e14a142be tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:28.742837 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d9672280-6c11-42f4-92a6-616e14a142be tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:28.749208 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d9672280-6c11-42f4-92a6-616e14a142be tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:28.749660 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d9672280-6c11-42f4-92a6-616e14a142be tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:28.750456 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d9672280-6c11-42f4-92a6-616e14a142be tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:28.751467 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d9672280-6c11-42f4-92a6-616e14a142be tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:28.898197 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d9672280-6c11-42f4-92a6-616e14a142be tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:28.907089 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d9672280-6c11-42f4-92a6-616e14a142be tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d" status: 200 len: 1264 microversion: 2.1 time: 0.168482 Dec 27 14:28:28.908065 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 485/993] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:28:28 2021] GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:28:29.312070 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-cef63c04-65bb-4d4a-bf5b-75a67b73d9e3 req-dcb4e4b8-23f1-4d5b-8a72-62df1e87fa47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d", "name": "network-vif-plugged", "status": "completed", "tag": "5b8c6947-5cbc-4988-981c-34cec1bb4240"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:28:29.313732 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:28:29.313732 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:28:29.324559 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-cef63c04-65bb-4d4a-bf5b-75a67b73d9e3 req-dcb4e4b8-23f1-4d5b-8a72-62df1e87fa47 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:29.325493 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-cef63c04-65bb-4d4a-bf5b-75a67b73d9e3 req-dcb4e4b8-23f1-4d5b-8a72-62df1e87fa47 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:29.339997 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-cef63c04-65bb-4d4a-bf5b-75a67b73d9e3 req-dcb4e4b8-23f1-4d5b-8a72-62df1e87fa47 service nova] Creating event network-vif-plugged:5b8c6947-5cbc-4988-981c-34cec1bb4240 for instance 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d on hv-cinder-82301 Dec 27 14:28:29.346108 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-cef63c04-65bb-4d4a-bf5b-75a67b73d9e3 req-dcb4e4b8-23f1-4d5b-8a72-62df1e87fa47 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037578 Dec 27 14:28:29.347689 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 509/994] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:28:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:28:29.926303 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-df8c3d4c-3c34-48e8-9112-bf014c7362eb tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:29.927081 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-df8c3d4c-3c34-48e8-9112-bf014c7362eb tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:29.933885 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df8c3d4c-3c34-48e8-9112-bf014c7362eb tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:29.934407 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df8c3d4c-3c34-48e8-9112-bf014c7362eb tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:29.935257 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df8c3d4c-3c34-48e8-9112-bf014c7362eb tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:29.935759 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df8c3d4c-3c34-48e8-9112-bf014c7362eb tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:30.074105 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-df8c3d4c-3c34-48e8-9112-bf014c7362eb tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:30.082132 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-df8c3d4c-3c34-48e8-9112-bf014c7362eb tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d" status: 200 len: 1264 microversion: 2.1 time: 0.162237 Dec 27 14:28:30.082694 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 486/995] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:28:29 2021] GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:28:31.102027 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9f19e27c-eec5-463d-b4bd-e4056b85d483 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:31.103367 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9f19e27c-eec5-463d-b4bd-e4056b85d483 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:31.112921 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9f19e27c-eec5-463d-b4bd-e4056b85d483 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:31.113639 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9f19e27c-eec5-463d-b4bd-e4056b85d483 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:31.114621 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9f19e27c-eec5-463d-b4bd-e4056b85d483 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:31.115250 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9f19e27c-eec5-463d-b4bd-e4056b85d483 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:31.378426 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9f19e27c-eec5-463d-b4bd-e4056b85d483 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:31.387725 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9f19e27c-eec5-463d-b4bd-e4056b85d483 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d" status: 200 len: 1264 microversion: 2.1 time: 0.292738 Dec 27 14:28:31.388566 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 510/996] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:28:31 2021] GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d => generated 1264 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:28:32.405594 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-83b6a7f1-f39d-4755-8c00-47f8016505f3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:32.406204 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-83b6a7f1-f39d-4755-8c00-47f8016505f3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:32.412833 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83b6a7f1-f39d-4755-8c00-47f8016505f3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:32.413277 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83b6a7f1-f39d-4755-8c00-47f8016505f3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:32.414108 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83b6a7f1-f39d-4755-8c00-47f8016505f3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:32.414536 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83b6a7f1-f39d-4755-8c00-47f8016505f3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:32.561433 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-83b6a7f1-f39d-4755-8c00-47f8016505f3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:32.569629 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-83b6a7f1-f39d-4755-8c00-47f8016505f3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d" status: 200 len: 1450 microversion: 2.1 time: 0.167893 Dec 27 14:28:32.570430 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 487/997] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:28:32 2021] GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d => generated 1450 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:28:32.588156 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-543962ff-2a90-4b83-97b4-1c6475600584 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:32.588156 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-543962ff-2a90-4b83-97b4-1c6475600584 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:32.593222 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-543962ff-2a90-4b83-97b4-1c6475600584 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:32.593729 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-543962ff-2a90-4b83-97b4-1c6475600584 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:32.594551 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-543962ff-2a90-4b83-97b4-1c6475600584 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:32.594995 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-543962ff-2a90-4b83-97b4-1c6475600584 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:32.808468 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-543962ff-2a90-4b83-97b4-1c6475600584 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:32.817142 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-543962ff-2a90-4b83-97b4-1c6475600584 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d" status: 200 len: 1450 microversion: 2.1 time: 0.234457 Dec 27 14:28:32.817720 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 511/998] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:28:32 2021] GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d => generated 1450 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:28:34.960388 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-f69df3a0-d3e7-4c49-b628-332e8675c91b req-4855e5a6-6ceb-428e-9286-cde05340a247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d", "tag": "5b8c6947-5cbc-4988-981c-34cec1bb4240"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:28:34.961890 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:28:34.961890 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:28:34.968829 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-f69df3a0-d3e7-4c49-b628-332e8675c91b req-4855e5a6-6ceb-428e-9286-cde05340a247 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:34.969316 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-f69df3a0-d3e7-4c49-b628-332e8675c91b req-4855e5a6-6ceb-428e-9286-cde05340a247 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:34.980152 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-f69df3a0-d3e7-4c49-b628-332e8675c91b req-4855e5a6-6ceb-428e-9286-cde05340a247 service nova] Creating event network-changed:5b8c6947-5cbc-4988-981c-34cec1bb4240 for instance 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d on hv-cinder-82301 Dec 27 14:28:34.985690 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-f69df3a0-d3e7-4c49-b628-332e8675c91b req-4855e5a6-6ceb-428e-9286-cde05340a247 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028252 Dec 27 14:28:34.986228 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 488/999] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:28:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:28:58.448577 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-cbaa036b-d7c9-4157-9d20-46aca7cdb781 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:58.449507 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-cbaa036b-d7c9-4157-9d20-46aca7cdb781 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:58.456795 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cbaa036b-d7c9-4157-9d20-46aca7cdb781 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:58.457250 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cbaa036b-d7c9-4157-9d20-46aca7cdb781 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:58.458040 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cbaa036b-d7c9-4157-9d20-46aca7cdb781 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:58.458484 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cbaa036b-d7c9-4157-9d20-46aca7cdb781 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:58.486759 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-cbaa036b-d7c9-4157-9d20-46aca7cdb781 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042001 Dec 27 14:28:58.487309 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 512/1000] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:28:58 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 27 14:28:58.542287 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-98d0e4ec-4a71-46ba-968f-efd9c76c5201 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:58.542864 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-98d0e4ec-4a71-46ba-968f-efd9c76c5201 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:58.548868 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-98d0e4ec-4a71-46ba-968f-efd9c76c5201 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:58.549312 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-98d0e4ec-4a71-46ba-968f-efd9c76c5201 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:58.550085 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-98d0e4ec-4a71-46ba-968f-efd9c76c5201 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:58.550512 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-98d0e4ec-4a71-46ba-968f-efd9c76c5201 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:58.574301 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-98d0e4ec-4a71-46ba-968f-efd9c76c5201 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 27 14:28:58.647347 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-98d0e4ec-4a71-46ba-968f-efd9c76c5201 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "DELETE /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 204 len: 0 microversion: 2.1 time: 0.109173 Dec 27 14:28:58.647952 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 489/1001] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Dec 27 14:28:58 2021] DELETE /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 27 14:28:58.656569 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2d436c98-737b-4520-949b-d24b9e9fcbc2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:58.657269 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2d436c98-737b-4520-949b-d24b9e9fcbc2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:58.663046 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2d436c98-737b-4520-949b-d24b9e9fcbc2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:58.663493 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2d436c98-737b-4520-949b-d24b9e9fcbc2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:58.664296 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2d436c98-737b-4520-949b-d24b9e9fcbc2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:58.664729 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2d436c98-737b-4520-949b-d24b9e9fcbc2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:58.793136 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-2d436c98-737b-4520-949b-d24b9e9fcbc2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:58.800404 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2d436c98-737b-4520-949b-d24b9e9fcbc2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1674 microversion: 2.1 time: 0.147970 Dec 27 14:28:58.800975 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 513/1002] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:28:58 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:28:59.817674 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a06a8ff6-53e9-4f40-b12f-396d9f37837c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:28:59.818366 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a06a8ff6-53e9-4f40-b12f-396d9f37837c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:28:59.824608 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a06a8ff6-53e9-4f40-b12f-396d9f37837c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:59.825050 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a06a8ff6-53e9-4f40-b12f-396d9f37837c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:59.825817 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a06a8ff6-53e9-4f40-b12f-396d9f37837c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:28:59.826247 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a06a8ff6-53e9-4f40-b12f-396d9f37837c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:28:59.958422 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a06a8ff6-53e9-4f40-b12f-396d9f37837c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:28:59.965759 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a06a8ff6-53e9-4f40-b12f-396d9f37837c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1674 microversion: 2.1 time: 0.152057 Dec 27 14:28:59.966558 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 490/1003] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:28:59 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:29:00.983066 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4db92045-4f71-4193-97df-0891a6e76d3a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:00.983702 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4db92045-4f71-4193-97df-0891a6e76d3a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:00.990190 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4db92045-4f71-4193-97df-0891a6e76d3a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:00.990649 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4db92045-4f71-4193-97df-0891a6e76d3a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:00.991437 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4db92045-4f71-4193-97df-0891a6e76d3a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:00.991900 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4db92045-4f71-4193-97df-0891a6e76d3a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:01.069141 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4db92045-4f71-4193-97df-0891a6e76d3a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:01.076952 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4db92045-4f71-4193-97df-0891a6e76d3a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 200 len: 1607 microversion: 2.1 time: 0.097813 Dec 27 14:29:01.086735 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 514/1004] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:29:00 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 1607 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:29:01.098318 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-a56717e3-063f-49da-bff2-864f71c89359 req-a61448db-8117-4e6e-a25d-854d8439058a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f72aa5e-493b-4d61-87f7-7da3af1ab7f4", "name": "network-vif-deleted", "tag": "59b42668-caea-412a-a372-6451c4f609df"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:01.100539 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:29:01.100539 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:29:01.108653 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-a56717e3-063f-49da-bff2-864f71c89359 req-a61448db-8117-4e6e-a25d-854d8439058a service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:01.110407 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-a56717e3-063f-49da-bff2-864f71c89359 req-a61448db-8117-4e6e-a25d-854d8439058a service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:01.123347 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-a56717e3-063f-49da-bff2-864f71c89359 req-a61448db-8117-4e6e-a25d-854d8439058a service nova] Creating event network-vif-deleted:59b42668-caea-412a-a372-6451c4f609df for instance 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 on hv-cinder-82301 Dec 27 14:29:01.133098 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-a56717e3-063f-49da-bff2-864f71c89359 req-a61448db-8117-4e6e-a25d-854d8439058a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038488 Dec 27 14:29:01.134409 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 491/1005] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:29:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:29:01.412095 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6842fa38-de29-495a-9581-68aa38717cff tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:01.412596 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6842fa38-de29-495a-9581-68aa38717cff tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:01.418521 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6842fa38-de29-495a-9581-68aa38717cff tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:01.419002 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6842fa38-de29-495a-9581-68aa38717cff tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:01.419783 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6842fa38-de29-495a-9581-68aa38717cff tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:01.420240 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6842fa38-de29-495a-9581-68aa38717cff tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:01.455364 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6842fa38-de29-495a-9581-68aa38717cff tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/os-volume_attachments/ad23d095-e994-4238-8870-82f0f45c8251" status: 200 len: 194 microversion: 2.20 time: 0.047570 Dec 27 14:29:01.455927 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 515/1006] 10.222.0.37 () {60 vars in 1453 bytes} [Mon Dec 27 14:29:01 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/os-volume_attachments/ad23d095-e994-4238-8870-82f0f45c8251 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:29:01.524665 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ace7519b-3368-45db-aead-3c7303cd421a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:01.525251 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ace7519b-3368-45db-aead-3c7303cd421a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:01.533943 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ace7519b-3368-45db-aead-3c7303cd421a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:01.534391 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ace7519b-3368-45db-aead-3c7303cd421a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:01.535385 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ace7519b-3368-45db-aead-3c7303cd421a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:01.535821 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ace7519b-3368-45db-aead-3c7303cd421a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:01.624514 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-ace7519b-3368-45db-aead-3c7303cd421a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lazy-loading 'services' on Instance uuid aad07b94-d83b-4d44-856c-80ac2e24b8b4 {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:29:01.698713 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ace7519b-3368-45db-aead-3c7303cd421a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "DELETE /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/os-volume_attachments/ad23d095-e994-4238-8870-82f0f45c8251" status: 202 len: 0 microversion: 2.20 time: 0.179018 Dec 27 14:29:01.699313 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 492/1007] 10.222.0.37 () {60 vars in 1456 bytes} [Mon Dec 27 14:29:01 2021] DELETE /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/os-volume_attachments/ad23d095-e994-4238-8870-82f0f45c8251 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 27 14:29:01.707970 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3b8e7d3e-e815-4a9b-8e99-7c372b46d3f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:01.708928 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3b8e7d3e-e815-4a9b-8e99-7c372b46d3f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:01.714833 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3b8e7d3e-e815-4a9b-8e99-7c372b46d3f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:01.715292 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3b8e7d3e-e815-4a9b-8e99-7c372b46d3f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:01.716155 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3b8e7d3e-e815-4a9b-8e99-7c372b46d3f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:01.716591 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3b8e7d3e-e815-4a9b-8e99-7c372b46d3f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:01.752425 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3b8e7d3e-e815-4a9b-8e99-7c372b46d3f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048650 Dec 27 14:29:01.752999 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 516/1008] 10.222.0.37 () {60 vars in 1342 bytes} [Mon Dec 27 14:29:01 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:29:02.095088 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c95252c2-539f-4e5b-b3cb-66abf2e07ffa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:02.095920 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c95252c2-539f-4e5b-b3cb-66abf2e07ffa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:02.102061 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c95252c2-539f-4e5b-b3cb-66abf2e07ffa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:02.102649 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c95252c2-539f-4e5b-b3cb-66abf2e07ffa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:02.103294 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c95252c2-539f-4e5b-b3cb-66abf2e07ffa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:02.103732 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c95252c2-539f-4e5b-b3cb-66abf2e07ffa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:02.117439 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-c95252c2-539f-4e5b-b3cb-66abf2e07ffa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] HTTP exception thrown: Instance 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 could not be found. Dec 27 14:29:02.118029 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c95252c2-539f-4e5b-b3cb-66abf2e07ffa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Returning 404 to user: Instance 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:29:02.118850 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c95252c2-539f-4e5b-b3cb-66abf2e07ffa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 404 len: 111 microversion: 2.1 time: 0.028601 Dec 27 14:29:02.119403 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 493/1009] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:29:02 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:29:02.128063 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ceae568d-97ec-423e-8dc1-8f9faddda394 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '.version_select at 0x7f8028307310>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:02.150209 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ceae568d-97ec-423e-8dc1-8f9faddda394 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1427882894" status: 202 len: 0 microversion: 2.1 time: 0.026035 Dec 27 14:29:02.150902 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 517/1010] 10.222.0.37 () {58 vars in 1220 bytes} [Mon Dec 27 14:29:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1427882894 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:29:02.763559 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-28ca7e4b-0ff7-4641-9380-4a75e464f2bb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:02.764525 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-28ca7e4b-0ff7-4641-9380-4a75e464f2bb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:02.771218 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-28ca7e4b-0ff7-4641-9380-4a75e464f2bb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:02.771660 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-28ca7e4b-0ff7-4641-9380-4a75e464f2bb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:02.772472 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-28ca7e4b-0ff7-4641-9380-4a75e464f2bb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:02.772912 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-28ca7e4b-0ff7-4641-9380-4a75e464f2bb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:02.803064 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-28ca7e4b-0ff7-4641-9380-4a75e464f2bb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043369 Dec 27 14:29:02.803724 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 494/1011] 10.222.0.37 () {60 vars in 1342 bytes} [Mon Dec 27 14:29:02 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:29:02.831322 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5f86f0e9-38de-43b8-aa86-621771c87e94 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'create', calling method: .version_select at 0x7f8028499a60>, body: {"keypair": {"name": "tempest-keypair-1311677689"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:02.845607 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-5f86f0e9-38de-43b8-aa86-621771c87e94 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Getting quotas for project 3987a0b7a4764509990d2849d59e6238. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:29:02.849394 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-5f86f0e9-38de-43b8-aa86-621771c87e94 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Getting quotas for user 4c8987f7dafc41f999a222eb0145ae95 and project 3987a0b7a4764509990d2849d59e6238. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:29:02.859243 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6c888ece-e686-4626-8896-c02a52ca5cc4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:02.860326 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6c888ece-e686-4626-8896-c02a52ca5cc4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:02.866128 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c888ece-e686-4626-8896-c02a52ca5cc4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:02.866575 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c888ece-e686-4626-8896-c02a52ca5cc4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:02.867356 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c888ece-e686-4626-8896-c02a52ca5cc4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:02.867793 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6c888ece-e686-4626-8896-c02a52ca5cc4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:02.892287 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6c888ece-e686-4626-8896-c02a52ca5cc4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 27 14:29:02.965789 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6c888ece-e686-4626-8896-c02a52ca5cc4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "DELETE /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 204 len: 0 microversion: 2.20 time: 0.109869 Dec 27 14:29:02.966370 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 495/1012] 10.222.0.37 () {60 vars in 1279 bytes} [Mon Dec 27 14:29:02 2021] DELETE /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 27 14:29:02.978340 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ce686430-0c87-4de8-a647-e6ed950daff9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:02.979340 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ce686430-0c87-4de8-a647-e6ed950daff9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:02.986578 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce686430-0c87-4de8-a647-e6ed950daff9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:02.987045 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce686430-0c87-4de8-a647-e6ed950daff9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:02.987808 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce686430-0c87-4de8-a647-e6ed950daff9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:02.988263 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce686430-0c87-4de8-a647-e6ed950daff9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:03.022315 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-5f86f0e9-38de-43b8-aa86-621771c87e94 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Getting quotas for project 3987a0b7a4764509990d2849d59e6238. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:29:03.026028 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-5f86f0e9-38de-43b8-aa86-621771c87e94 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Getting quotas for user 4c8987f7dafc41f999a222eb0145ae95 and project 3987a0b7a4764509990d2849d59e6238. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:29:03.039445 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5f86f0e9-38de-43b8-aa86-621771c87e94 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.211967 Dec 27 14:29:03.040087 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 518/1013] 10.222.0.37 () {60 vars in 1157 bytes} [Mon Dec 27 14:29:02 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:29:03.128932 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ce686430-0c87-4de8-a647-e6ed950daff9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:03.137489 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ce686430-0c87-4de8-a647-e6ed950daff9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:03.139000 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ce686430-0c87-4de8-a647-e6ed950daff9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:03.140540 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ce686430-0c87-4de8-a647-e6ed950daff9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1723 microversion: 2.20 time: 0.167530 Dec 27 14:29:03.141714 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 496/1014] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:29:02 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:29:04.160551 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c07e9e3f-9503-4dec-8969-c4dd4177d3fe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:04.161172 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c07e9e3f-9503-4dec-8969-c4dd4177d3fe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:04.167546 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c07e9e3f-9503-4dec-8969-c4dd4177d3fe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:04.168037 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c07e9e3f-9503-4dec-8969-c4dd4177d3fe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:04.168826 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c07e9e3f-9503-4dec-8969-c4dd4177d3fe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:04.169267 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c07e9e3f-9503-4dec-8969-c4dd4177d3fe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:04.295579 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4616f5cc-1d99-43f4-b5ad-f19af74b3ff3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1239429520", "imageRef": "c8bd383f-96c5-4e2b-aaa5-fabd68b307f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "67a7decc-c7a3-4b69-8e7b-3eb61e173248"}], "security_groups": [{"name": "tempest-securitygroup--1317050564"}], "key_name": "tempest-keypair-1311677689", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:04.310491 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c07e9e3f-9503-4dec-8969-c4dd4177d3fe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:04.319878 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c07e9e3f-9503-4dec-8969-c4dd4177d3fe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:04.321358 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c07e9e3f-9503-4dec-8969-c4dd4177d3fe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:04.322508 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c07e9e3f-9503-4dec-8969-c4dd4177d3fe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1723 microversion: 2.20 time: 0.166336 Dec 27 14:29:04.323062 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 519/1015] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:29:04 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:29:04.397559 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-4616f5cc-1d99-43f4-b5ad-f19af74b3ff3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] validate_networks() for [('67a7decc-c7a3-4b69-8e7b-3eb61e173248', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 27 14:29:04.760024 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-4616f5cc-1d99-43f4-b5ad-f19af74b3ff3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 27 14:29:04.760448 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-4616f5cc-1d99-43f4-b5ad-f19af74b3ff3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 27 14:29:04.760917 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-4616f5cc-1d99-43f4-b5ad-f19af74b3ff3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 27 14:29:04.761321 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-4616f5cc-1d99-43f4-b5ad-f19af74b3ff3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 27 14:29:04.761727 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-4616f5cc-1d99-43f4-b5ad-f19af74b3ff3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 27 14:29:04.770909 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4616f5cc-1d99-43f4-b5ad-f19af74b3ff3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:04.771350 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4616f5cc-1d99-43f4-b5ad-f19af74b3ff3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:04.772193 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4616f5cc-1d99-43f4-b5ad-f19af74b3ff3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:04.772626 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4616f5cc-1d99-43f4-b5ad-f19af74b3ff3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:04.788686 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-4616f5cc-1d99-43f4-b5ad-f19af74b3ff3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Getting quotas for project 3987a0b7a4764509990d2849d59e6238. Resources: {'cores', 'ram', 'instances'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:29:04.792515 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-4616f5cc-1d99-43f4-b5ad-f19af74b3ff3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Getting quotas for user 4c8987f7dafc41f999a222eb0145ae95 and project 3987a0b7a4764509990d2849d59e6238. Resources: {'cores', 'ram', 'instances'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:29:04.802901 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4616f5cc-1d99-43f4-b5ad-f19af74b3ff3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 27 14:29:04.805179 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4616f5cc-1d99-43f4-b5ad-f19af74b3ff3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c8bd383f-96c5-4e2b-aaa5-fabd68b307f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 27 14:29:04.851912 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4616f5cc-1d99-43f4-b5ad-f19af74b3ff3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.560236 Dec 27 14:29:04.852559 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 497/1016] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Dec 27 14:29:04 2021] POST /compute/v2.1/servers => generated 402 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 27 14:29:04.863022 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2a9e03e9-8892-4971-8d2b-454279159332 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:04.863641 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2a9e03e9-8892-4971-8d2b-454279159332 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:04.915123 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-2a9e03e9-8892-4971-8d2b-454279159332 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:04.922385 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2a9e03e9-8892-4971-8d2b-454279159332 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804" status: 200 len: 1238 microversion: 2.1 time: 0.063229 Dec 27 14:29:04.923142 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 520/1017] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:29:04 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804 => generated 1238 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:29:05.340809 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cf4b3dbf-8c79-448f-9165-16b4f037e999 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:05.341414 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cf4b3dbf-8c79-448f-9165-16b4f037e999 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:05.358901 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf4b3dbf-8c79-448f-9165-16b4f037e999 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:05.359374 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf4b3dbf-8c79-448f-9165-16b4f037e999 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:05.369003 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf4b3dbf-8c79-448f-9165-16b4f037e999 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:05.369713 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cf4b3dbf-8c79-448f-9165-16b4f037e999 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:05.586553 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cf4b3dbf-8c79-448f-9165-16b4f037e999 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:05.594251 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cf4b3dbf-8c79-448f-9165-16b4f037e999 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:05.595981 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cf4b3dbf-8c79-448f-9165-16b4f037e999 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:05.597137 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cf4b3dbf-8c79-448f-9165-16b4f037e999 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 200 len: 1723 microversion: 2.20 time: 0.260060 Dec 27 14:29:05.597909 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 498/1018] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:29:05 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:29:05.941010 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-364446bf-24a6-41ed-bfc9-58898ae411cb req-7c812ac7-f045-48ad-9464-d517339c083d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aad07b94-d83b-4d44-856c-80ac2e24b8b4", "name": "network-vif-deleted", "tag": "d8953eb3-d364-4473-98c5-e33562dcd960"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:05.943326 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:29:05.943326 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:29:05.947209 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-53f5b068-1d09-4332-a8d9-21e0b041735c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:05.947978 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-53f5b068-1d09-4332-a8d9-21e0b041735c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:05.953681 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-364446bf-24a6-41ed-bfc9-58898ae411cb req-7c812ac7-f045-48ad-9464-d517339c083d service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:05.954341 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-364446bf-24a6-41ed-bfc9-58898ae411cb req-7c812ac7-f045-48ad-9464-d517339c083d service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:05.962202 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53f5b068-1d09-4332-a8d9-21e0b041735c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:05.962954 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53f5b068-1d09-4332-a8d9-21e0b041735c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:05.963995 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53f5b068-1d09-4332-a8d9-21e0b041735c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:05.964657 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-53f5b068-1d09-4332-a8d9-21e0b041735c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:05.988952 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-364446bf-24a6-41ed-bfc9-58898ae411cb req-7c812ac7-f045-48ad-9464-d517339c083d service nova] Creating event network-vif-deleted:d8953eb3-d364-4473-98c5-e33562dcd960 for instance aad07b94-d83b-4d44-856c-80ac2e24b8b4 on hv-cinder-82301 Dec 27 14:29:06.008807 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-364446bf-24a6-41ed-bfc9-58898ae411cb req-7c812ac7-f045-48ad-9464-d517339c083d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077303 Dec 27 14:29:06.011665 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 521/1019] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:29:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:29:06.067615 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-53f5b068-1d09-4332-a8d9-21e0b041735c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:06.075538 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-53f5b068-1d09-4332-a8d9-21e0b041735c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804" status: 200 len: 1296 microversion: 2.1 time: 0.140852 Dec 27 14:29:06.085649 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 499/1020] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:29:05 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804 => generated 1296 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:29:06.618502 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d17adf8d-5ca2-424c-856b-c6921d95a1e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:06.620423 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d17adf8d-5ca2-424c-856b-c6921d95a1e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:06.628849 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d17adf8d-5ca2-424c-856b-c6921d95a1e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:06.629673 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d17adf8d-5ca2-424c-856b-c6921d95a1e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:06.630901 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d17adf8d-5ca2-424c-856b-c6921d95a1e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:06.632196 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d17adf8d-5ca2-424c-856b-c6921d95a1e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:06.650391 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-d17adf8d-5ca2-424c-856b-c6921d95a1e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] HTTP exception thrown: Instance aad07b94-d83b-4d44-856c-80ac2e24b8b4 could not be found. Dec 27 14:29:06.650775 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d17adf8d-5ca2-424c-856b-c6921d95a1e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Returning 404 to user: Instance aad07b94-d83b-4d44-856c-80ac2e24b8b4 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:29:06.651712 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d17adf8d-5ca2-424c-856b-c6921d95a1e1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 404 len: 111 microversion: 2.20 time: 0.037769 Dec 27 14:29:06.652904 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 522/1021] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:29:06 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 27 14:29:06.663493 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2646b03a-0c13-4cb4-b5d6-7f06abf084b3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '.version_select at 0x7f80282c3040>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:06.667787 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2646b03a-0c13-4cb4-b5d6-7f06abf084b3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [897c2a44-c652-4704-a030-fef0b570ea23] AMQP server on 10.222.0.37:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 27 14:29:07.092608 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6f5d4405-b444-4eba-a9f6-5830e5a4ded2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:07.093237 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6f5d4405-b444-4eba-a9f6-5830e5a4ded2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:07.101488 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6f5d4405-b444-4eba-a9f6-5830e5a4ded2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:07.101962 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6f5d4405-b444-4eba-a9f6-5830e5a4ded2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:07.102788 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6f5d4405-b444-4eba-a9f6-5830e5a4ded2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:07.103233 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6f5d4405-b444-4eba-a9f6-5830e5a4ded2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:07.360762 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6f5d4405-b444-4eba-a9f6-5830e5a4ded2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:07.368526 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6f5d4405-b444-4eba-a9f6-5830e5a4ded2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804" status: 200 len: 1364 microversion: 2.1 time: 0.279667 Dec 27 14:29:07.369114 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 523/1022] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:29:07 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804 => generated 1364 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:29:07.374034 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-e9ee8b82-b710-49d3-ae62-cddf9f659303 req-b3454b7e-1cbc-44b3-8e03-6022c665de02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b2fac49-b603-495e-a648-b56ca6920804", "tag": "8b910194-49c4-4494-b8a1-60502c78b5a1"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:07.376511 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:29:07.376511 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:29:07.384336 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-e9ee8b82-b710-49d3-ae62-cddf9f659303 req-b3454b7e-1cbc-44b3-8e03-6022c665de02 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:07.384781 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-e9ee8b82-b710-49d3-ae62-cddf9f659303 req-b3454b7e-1cbc-44b3-8e03-6022c665de02 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:07.395958 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-e9ee8b82-b710-49d3-ae62-cddf9f659303 req-b3454b7e-1cbc-44b3-8e03-6022c665de02 service nova] Creating event network-changed:8b910194-49c4-4494-b8a1-60502c78b5a1 for instance 4b2fac49-b603-495e-a648-b56ca6920804 on hv-cinder-82301 Dec 27 14:29:07.400678 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-e9ee8b82-b710-49d3-ae62-cddf9f659303 req-b3454b7e-1cbc-44b3-8e03-6022c665de02 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030215 Dec 27 14:29:07.401269 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 524/1023] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:29:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:29:07.676382 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [None req-2646b03a-0c13-4cb4-b5d6-7f06abf084b3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [897c2a44-c652-4704-a030-fef0b570ea23] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 35890. Dec 27 14:29:07.707310 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2646b03a-0c13-4cb4-b5d6-7f06abf084b3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-718376350" status: 204 len: 0 microversion: 2.20 time: 1.047411 Dec 27 14:29:07.711370 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 500/1024] 10.222.0.37 () {60 vars in 1258 bytes} [Mon Dec 27 14:29:06 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-718376350 => generated 0 bytes in 1051 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 27 14:29:08.386837 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-65977a16-20e4-4cae-8807-79f83966b6e0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:08.387534 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-65977a16-20e4-4cae-8807-79f83966b6e0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:08.394230 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65977a16-20e4-4cae-8807-79f83966b6e0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:08.394678 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65977a16-20e4-4cae-8807-79f83966b6e0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:08.395465 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65977a16-20e4-4cae-8807-79f83966b6e0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:08.395923 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-65977a16-20e4-4cae-8807-79f83966b6e0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:08.655433 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-65977a16-20e4-4cae-8807-79f83966b6e0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:08.664891 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-65977a16-20e4-4cae-8807-79f83966b6e0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804" status: 200 len: 1364 microversion: 2.1 time: 0.282375 Dec 27 14:29:08.665484 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 525/1025] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:29:08 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804 => generated 1364 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:29:08.806761 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4334e1c3-c68b-4da8-815d-154023407ac3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'create', calling method: .version_select at 0x7f802837c040>, body: {"keypair": {"name": "tempest-keypair-1787802580"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:08.822755 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-4334e1c3-c68b-4da8-815d-154023407ac3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Getting quotas for project cb5e638b0aa0424484c3eb48434d7e66. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:29:08.826473 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-4334e1c3-c68b-4da8-815d-154023407ac3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Getting quotas for user 1cfb17ae7cd742e191aa3d456e4346d0 and project cb5e638b0aa0424484c3eb48434d7e66. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:29:09.019377 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-4334e1c3-c68b-4da8-815d-154023407ac3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Getting quotas for project cb5e638b0aa0424484c3eb48434d7e66. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:29:09.023670 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-4334e1c3-c68b-4da8-815d-154023407ac3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Getting quotas for user 1cfb17ae7cd742e191aa3d456e4346d0 and project cb5e638b0aa0424484c3eb48434d7e66. Resources: {'key_pairs'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:29:09.037250 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4334e1c3-c68b-4da8-815d-154023407ac3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.234668 Dec 27 14:29:09.037848 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 501/1026] 10.222.0.37 () {62 vars in 1198 bytes} [Mon Dec 27 14:29:08 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 236 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 27 14:29:09.682207 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1942b776-4045-4d77-b533-288e1ea29897 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:09.682808 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1942b776-4045-4d77-b533-288e1ea29897 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:09.689976 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1942b776-4045-4d77-b533-288e1ea29897 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:09.690421 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1942b776-4045-4d77-b533-288e1ea29897 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:09.691201 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1942b776-4045-4d77-b533-288e1ea29897 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:09.691633 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1942b776-4045-4d77-b533-288e1ea29897 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:09.893311 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1942b776-4045-4d77-b533-288e1ea29897 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:09.900621 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1942b776-4045-4d77-b533-288e1ea29897 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804" status: 200 len: 1364 microversion: 2.1 time: 0.222119 Dec 27 14:29:09.901391 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 526/1027] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:29:09 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804 => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:29:10.619374 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0df4d825-407e-4d09-bc20-a2197dea0185 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-177198515", "imageRef": "c8bd383f-96c5-4e2b-aaa5-fabd68b307f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d685d204-a878-46a9-9c80-314fd33c30a4"}], "security_groups": [{"name": "tempest-securitygroup--514334281"}], "key_name": "tempest-keypair-1787802580", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:10.717063 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-0df4d825-407e-4d09-bc20-a2197dea0185 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] validate_networks() for [('d685d204-a878-46a9-9c80-314fd33c30a4', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 27 14:29:10.918485 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d8513f42-4bd1-4018-a677-b2c8f78487fc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:10.919691 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d8513f42-4bd1-4018-a677-b2c8f78487fc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:10.926646 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8513f42-4bd1-4018-a677-b2c8f78487fc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:10.927099 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8513f42-4bd1-4018-a677-b2c8f78487fc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:10.927914 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8513f42-4bd1-4018-a677-b2c8f78487fc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:10.928357 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d8513f42-4bd1-4018-a677-b2c8f78487fc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:11.062252 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d8513f42-4bd1-4018-a677-b2c8f78487fc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:11.069827 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d8513f42-4bd1-4018-a677-b2c8f78487fc tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804" status: 200 len: 1364 microversion: 2.1 time: 0.155430 Dec 27 14:29:11.070406 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 527/1028] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:29:10 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:29:11.081913 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-0df4d825-407e-4d09-bc20-a2197dea0185 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 27 14:29:11.082335 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-0df4d825-407e-4d09-bc20-a2197dea0185 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 27 14:29:11.082809 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-0df4d825-407e-4d09-bc20-a2197dea0185 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 27 14:29:11.083217 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-0df4d825-407e-4d09-bc20-a2197dea0185 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 27 14:29:11.083633 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-0df4d825-407e-4d09-bc20-a2197dea0185 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 27 14:29:11.092555 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0df4d825-407e-4d09-bc20-a2197dea0185 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:11.093004 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0df4d825-407e-4d09-bc20-a2197dea0185 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:11.094439 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0df4d825-407e-4d09-bc20-a2197dea0185 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:11.094882 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0df4d825-407e-4d09-bc20-a2197dea0185 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:11.112423 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-0df4d825-407e-4d09-bc20-a2197dea0185 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Getting quotas for project cb5e638b0aa0424484c3eb48434d7e66. Resources: {'cores', 'ram', 'instances'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:29:11.116253 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-0df4d825-407e-4d09-bc20-a2197dea0185 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Getting quotas for user 1cfb17ae7cd742e191aa3d456e4346d0 and project cb5e638b0aa0424484c3eb48434d7e66. Resources: {'cores', 'ram', 'instances'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:29:11.127522 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0df4d825-407e-4d09-bc20-a2197dea0185 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 27 14:29:11.130008 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0df4d825-407e-4d09-bc20-a2197dea0185 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c8bd383f-96c5-4e2b-aaa5-fabd68b307f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 27 14:29:11.176383 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0df4d825-407e-4d09-bc20-a2197dea0185 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.561876 Dec 27 14:29:11.177262 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 502/1029] 10.222.0.37 () {62 vars in 1187 bytes} [Mon Dec 27 14:29:10 2021] POST /compute/v2.1/servers => generated 401 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 27 14:29:11.186608 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1c4fd5b4-898e-433b-b03e-3d3b7b80ff76 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:11.187530 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1c4fd5b4-898e-433b-b03e-3d3b7b80ff76 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:11.251276 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1c4fd5b4-898e-433b-b03e-3d3b7b80ff76 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:11.258979 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1c4fd5b4-898e-433b-b03e-3d3b7b80ff76 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:11.262168 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1c4fd5b4-898e-433b-b03e-3d3b7b80ff76 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:11.264952 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1c4fd5b4-898e-433b-b03e-3d3b7b80ff76 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1281 microversion: 2.20 time: 0.081954 Dec 27 14:29:11.266193 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 528/1030] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:29:11 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1281 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:29:12.087759 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c9aaa86a-4e57-4681-be63-3920dc648382 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:12.088389 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c9aaa86a-4e57-4681-be63-3920dc648382 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:12.094815 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c9aaa86a-4e57-4681-be63-3920dc648382 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:12.095265 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c9aaa86a-4e57-4681-be63-3920dc648382 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:12.096067 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c9aaa86a-4e57-4681-be63-3920dc648382 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:12.096506 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c9aaa86a-4e57-4681-be63-3920dc648382 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:12.249327 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c9aaa86a-4e57-4681-be63-3920dc648382 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:12.257037 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c9aaa86a-4e57-4681-be63-3920dc648382 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804" status: 200 len: 1364 microversion: 2.1 time: 0.173352 Dec 27 14:29:12.257625 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 503/1031] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:29:12 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:29:12.283346 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4eefaf85-70db-4d93-bb36-90a8cb85b14f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:12.284061 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4eefaf85-70db-4d93-bb36-90a8cb85b14f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:12.291380 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4eefaf85-70db-4d93-bb36-90a8cb85b14f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:12.291935 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4eefaf85-70db-4d93-bb36-90a8cb85b14f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:12.292789 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4eefaf85-70db-4d93-bb36-90a8cb85b14f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:12.293293 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4eefaf85-70db-4d93-bb36-90a8cb85b14f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:12.357367 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4eefaf85-70db-4d93-bb36-90a8cb85b14f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:12.365747 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4eefaf85-70db-4d93-bb36-90a8cb85b14f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:12.367392 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4eefaf85-70db-4d93-bb36-90a8cb85b14f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:12.368739 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4eefaf85-70db-4d93-bb36-90a8cb85b14f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1339 microversion: 2.20 time: 0.089995 Dec 27 14:29:12.369409 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 529/1032] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:29:12 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1339 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:29:13.268158 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-5dcbab7c-5194-471d-9e31-6ff583ad6584 req-f1147f5a-fe2d-4528-b67d-757497bdcaa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b2fac49-b603-495e-a648-b56ca6920804", "name": "network-vif-plugged", "status": "completed", "tag": "8b910194-49c4-4494-b8a1-60502c78b5a1"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:13.270308 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:29:13.270308 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:29:13.272957 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5071fc9d-45d4-4b0a-a577-eb1381578103 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:13.276871 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5071fc9d-45d4-4b0a-a577-eb1381578103 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:13.277535 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-5dcbab7c-5194-471d-9e31-6ff583ad6584 req-f1147f5a-fe2d-4528-b67d-757497bdcaa5 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:13.277971 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-5dcbab7c-5194-471d-9e31-6ff583ad6584 req-f1147f5a-fe2d-4528-b67d-757497bdcaa5 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:13.286551 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5071fc9d-45d4-4b0a-a577-eb1381578103 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:13.287618 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5071fc9d-45d4-4b0a-a577-eb1381578103 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:13.289169 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5071fc9d-45d4-4b0a-a577-eb1381578103 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:13.290036 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5071fc9d-45d4-4b0a-a577-eb1381578103 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:13.309173 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-5dcbab7c-5194-471d-9e31-6ff583ad6584 req-f1147f5a-fe2d-4528-b67d-757497bdcaa5 service nova] Creating event network-vif-plugged:8b910194-49c4-4494-b8a1-60502c78b5a1 for instance 4b2fac49-b603-495e-a648-b56ca6920804 on hv-cinder-82301 Dec 27 14:29:13.315705 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-5dcbab7c-5194-471d-9e31-6ff583ad6584 req-f1147f5a-fe2d-4528-b67d-757497bdcaa5 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051814 Dec 27 14:29:13.317449 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 504/1033] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:29:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:29:13.388240 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f95cf892-79fe-4d3f-a3ec-c5829fb2538f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:13.389086 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f95cf892-79fe-4d3f-a3ec-c5829fb2538f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:13.396973 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f95cf892-79fe-4d3f-a3ec-c5829fb2538f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:13.398118 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f95cf892-79fe-4d3f-a3ec-c5829fb2538f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:13.399179 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f95cf892-79fe-4d3f-a3ec-c5829fb2538f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:13.399865 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f95cf892-79fe-4d3f-a3ec-c5829fb2538f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:13.553763 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5071fc9d-45d4-4b0a-a577-eb1381578103 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:13.563536 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5071fc9d-45d4-4b0a-a577-eb1381578103 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804" status: 200 len: 1364 microversion: 2.1 time: 0.294167 Dec 27 14:29:13.564326 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 530/1034] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:29:13 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804 => generated 1364 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:29:13.570142 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-4c35cf2d-8929-4fa3-8a8f-3ef6ff770795 req-2113ea85-cac7-4c0e-9f5e-dcf05290a65a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f23091f-27bc-4397-ad23-c7aeafafb970", "tag": "d5856f9b-e239-4613-88a7-d15a19d0765d"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:13.572221 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:29:13.572221 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:29:13.582965 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-4c35cf2d-8929-4fa3-8a8f-3ef6ff770795 req-2113ea85-cac7-4c0e-9f5e-dcf05290a65a service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:13.583887 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-4c35cf2d-8929-4fa3-8a8f-3ef6ff770795 req-2113ea85-cac7-4c0e-9f5e-dcf05290a65a service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:13.598505 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-4c35cf2d-8929-4fa3-8a8f-3ef6ff770795 req-2113ea85-cac7-4c0e-9f5e-dcf05290a65a service nova] Creating event network-changed:d5856f9b-e239-4613-88a7-d15a19d0765d for instance 5f23091f-27bc-4397-ad23-c7aeafafb970 on hv-cinder-82301 Dec 27 14:29:13.606757 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-4c35cf2d-8929-4fa3-8a8f-3ef6ff770795 req-2113ea85-cac7-4c0e-9f5e-dcf05290a65a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040817 Dec 27 14:29:13.607681 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 531/1035] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:29:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:29:13.625872 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f95cf892-79fe-4d3f-a3ec-c5829fb2538f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:13.635193 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f95cf892-79fe-4d3f-a3ec-c5829fb2538f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:13.637170 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f95cf892-79fe-4d3f-a3ec-c5829fb2538f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:13.638493 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f95cf892-79fe-4d3f-a3ec-c5829fb2538f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1406 microversion: 2.20 time: 0.254585 Dec 27 14:29:13.639362 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 505/1036] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:29:13 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:29:14.581088 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d10e8257-8242-4177-adbe-fc69c4b0ed71 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:14.581913 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d10e8257-8242-4177-adbe-fc69c4b0ed71 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:14.587931 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d10e8257-8242-4177-adbe-fc69c4b0ed71 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:14.588384 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d10e8257-8242-4177-adbe-fc69c4b0ed71 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:14.589165 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d10e8257-8242-4177-adbe-fc69c4b0ed71 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:14.589603 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d10e8257-8242-4177-adbe-fc69c4b0ed71 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:14.657538 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d91a2b51-68d4-4f73-a784-4c749ef9e1b3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:14.658065 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d91a2b51-68d4-4f73-a784-4c749ef9e1b3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:14.664453 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d91a2b51-68d4-4f73-a784-4c749ef9e1b3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:14.664903 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d91a2b51-68d4-4f73-a784-4c749ef9e1b3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:14.665683 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d91a2b51-68d4-4f73-a784-4c749ef9e1b3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:14.666118 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d91a2b51-68d4-4f73-a784-4c749ef9e1b3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:14.793723 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d10e8257-8242-4177-adbe-fc69c4b0ed71 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:14.799326 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d91a2b51-68d4-4f73-a784-4c749ef9e1b3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:14.801637 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d10e8257-8242-4177-adbe-fc69c4b0ed71 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804" status: 200 len: 1364 microversion: 2.1 time: 0.225163 Dec 27 14:29:14.802205 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 532/1037] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:29:14 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:29:14.806999 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d91a2b51-68d4-4f73-a784-4c749ef9e1b3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:14.808545 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d91a2b51-68d4-4f73-a784-4c749ef9e1b3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:14.809652 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d91a2b51-68d4-4f73-a784-4c749ef9e1b3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1406 microversion: 2.20 time: 0.156840 Dec 27 14:29:14.810194 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 506/1038] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:29:14 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:29:15.818733 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b761742b-3029-42ca-a3c9-9684da079ccd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:15.819337 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b761742b-3029-42ca-a3c9-9684da079ccd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:15.826196 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b761742b-3029-42ca-a3c9-9684da079ccd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:15.826649 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b761742b-3029-42ca-a3c9-9684da079ccd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:15.827309 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-32c1e6be-aab7-49a9-b8c2-81d35b930e0a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:15.828347 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b761742b-3029-42ca-a3c9-9684da079ccd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:15.828559 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-32c1e6be-aab7-49a9-b8c2-81d35b930e0a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:15.828717 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b761742b-3029-42ca-a3c9-9684da079ccd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:15.834875 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32c1e6be-aab7-49a9-b8c2-81d35b930e0a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:15.835329 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32c1e6be-aab7-49a9-b8c2-81d35b930e0a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:15.836140 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32c1e6be-aab7-49a9-b8c2-81d35b930e0a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:15.836579 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32c1e6be-aab7-49a9-b8c2-81d35b930e0a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:15.966095 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-32c1e6be-aab7-49a9-b8c2-81d35b930e0a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:15.967476 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b761742b-3029-42ca-a3c9-9684da079ccd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:15.973916 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-32c1e6be-aab7-49a9-b8c2-81d35b930e0a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:15.975132 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b761742b-3029-42ca-a3c9-9684da079ccd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804" status: 200 len: 1550 microversion: 2.1 time: 0.160038 Dec 27 14:29:15.975394 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-32c1e6be-aab7-49a9-b8c2-81d35b930e0a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:15.975716 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 533/1039] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:29:15 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804 => generated 1550 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:29:15.976647 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-32c1e6be-aab7-49a9-b8c2-81d35b930e0a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1406 microversion: 2.20 time: 0.152867 Dec 27 14:29:15.977199 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 507/1040] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:29:15 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:29:15.990691 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4185242b-8e2a-4c30-ad18-43163dc98d23 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:15.991184 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4185242b-8e2a-4c30-ad18-43163dc98d23 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:15.996914 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4185242b-8e2a-4c30-ad18-43163dc98d23 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:15.997368 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4185242b-8e2a-4c30-ad18-43163dc98d23 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:15.998146 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4185242b-8e2a-4c30-ad18-43163dc98d23 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:15.998594 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4185242b-8e2a-4c30-ad18-43163dc98d23 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:16.077040 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4185242b-8e2a-4c30-ad18-43163dc98d23 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089738 Dec 27 14:29:16.078346 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 534/1041] 10.222.0.37 () {58 vars in 1274 bytes} [Mon Dec 27 14:29:15 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:29:16.993804 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b3ace846-80d5-418e-ac26-e6c652f9cfc5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:16.995234 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b3ace846-80d5-418e-ac26-e6c652f9cfc5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:17.003467 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c52bc570-26c6-43ad-b40f-2125f450e88e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:17.004273 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b3ace846-80d5-418e-ac26-e6c652f9cfc5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:17.004656 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c52bc570-26c6-43ad-b40f-2125f450e88e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:17.004840 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b3ace846-80d5-418e-ac26-e6c652f9cfc5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:17.005747 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b3ace846-80d5-418e-ac26-e6c652f9cfc5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:17.006420 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b3ace846-80d5-418e-ac26-e6c652f9cfc5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:17.012723 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c52bc570-26c6-43ad-b40f-2125f450e88e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:17.013176 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c52bc570-26c6-43ad-b40f-2125f450e88e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:17.013965 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c52bc570-26c6-43ad-b40f-2125f450e88e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:17.014430 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c52bc570-26c6-43ad-b40f-2125f450e88e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:17.084892 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c52bc570-26c6-43ad-b40f-2125f450e88e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 14 microversion: 2.1 time: 0.084889 Dec 27 14:29:17.085743 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 535/1042] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:16 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 27 14:29:17.090932 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-18b39dac-09d1-4297-941e-11c991d5742e req-677ffb3a-debd-4973-a048-f5f07c9615c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b2fac49-b603-495e-a648-b56ca6920804", "tag": "8b910194-49c4-4494-b8a1-60502c78b5a1"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:17.092627 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:29:17.092627 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:29:17.104110 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-18b39dac-09d1-4297-941e-11c991d5742e req-677ffb3a-debd-4973-a048-f5f07c9615c1 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:17.104617 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-18b39dac-09d1-4297-941e-11c991d5742e req-677ffb3a-debd-4973-a048-f5f07c9615c1 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:17.118460 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-18b39dac-09d1-4297-941e-11c991d5742e req-677ffb3a-debd-4973-a048-f5f07c9615c1 service nova] Creating event network-changed:8b910194-49c4-4494-b8a1-60502c78b5a1 for instance 4b2fac49-b603-495e-a648-b56ca6920804 on hv-cinder-82301 Dec 27 14:29:17.123525 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-18b39dac-09d1-4297-941e-11c991d5742e req-677ffb3a-debd-4973-a048-f5f07c9615c1 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036086 Dec 27 14:29:17.127927 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 536/1043] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:29:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:29:17.159093 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b3ace846-80d5-418e-ac26-e6c652f9cfc5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:17.167265 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b3ace846-80d5-418e-ac26-e6c652f9cfc5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:17.168897 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b3ace846-80d5-418e-ac26-e6c652f9cfc5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:17.170067 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b3ace846-80d5-418e-ac26-e6c652f9cfc5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1406 microversion: 2.20 time: 0.180086 Dec 27 14:29:17.170697 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 508/1044] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:29:16 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:29:18.096968 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7db9a167-b116-46b2-bf22-42d0d9848297 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:18.097977 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7db9a167-b116-46b2-bf22-42d0d9848297 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:18.103951 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7db9a167-b116-46b2-bf22-42d0d9848297 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:18.104406 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7db9a167-b116-46b2-bf22-42d0d9848297 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:18.105190 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7db9a167-b116-46b2-bf22-42d0d9848297 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:18.105627 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7db9a167-b116-46b2-bf22-42d0d9848297 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:18.165412 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7db9a167-b116-46b2-bf22-42d0d9848297 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 14 microversion: 2.1 time: 0.072687 Dec 27 14:29:18.166086 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 537/1045] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:18 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 27 14:29:18.188818 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b0d0e8fb-c301-4df6-b603-722dc2e957af tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:18.189460 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b0d0e8fb-c301-4df6-b603-722dc2e957af tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:18.195785 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0d0e8fb-c301-4df6-b603-722dc2e957af tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:18.196271 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0d0e8fb-c301-4df6-b603-722dc2e957af tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:18.197052 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0d0e8fb-c301-4df6-b603-722dc2e957af tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:18.197490 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b0d0e8fb-c301-4df6-b603-722dc2e957af tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:18.331279 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b0d0e8fb-c301-4df6-b603-722dc2e957af tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:18.338997 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b0d0e8fb-c301-4df6-b603-722dc2e957af tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:18.340539 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b0d0e8fb-c301-4df6-b603-722dc2e957af tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:18.341624 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b0d0e8fb-c301-4df6-b603-722dc2e957af tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1406 microversion: 2.20 time: 0.156999 Dec 27 14:29:18.342181 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 509/1046] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:29:18 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:29:19.176777 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fecf5b37-6fea-4d66-93f4-1c0e31b99197 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:19.177791 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fecf5b37-6fea-4d66-93f4-1c0e31b99197 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:19.184769 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fecf5b37-6fea-4d66-93f4-1c0e31b99197 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:19.185233 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fecf5b37-6fea-4d66-93f4-1c0e31b99197 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:19.186029 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fecf5b37-6fea-4d66-93f4-1c0e31b99197 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:19.186467 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fecf5b37-6fea-4d66-93f4-1c0e31b99197 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:19.244347 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fecf5b37-6fea-4d66-93f4-1c0e31b99197 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 14 microversion: 2.1 time: 0.071404 Dec 27 14:29:19.247602 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 538/1047] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:19 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 27 14:29:19.359745 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1d39a5eb-3d24-4ccd-a3b9-92a804cf90c4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:19.360380 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1d39a5eb-3d24-4ccd-a3b9-92a804cf90c4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:19.366599 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d39a5eb-3d24-4ccd-a3b9-92a804cf90c4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:19.367047 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d39a5eb-3d24-4ccd-a3b9-92a804cf90c4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:19.367827 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d39a5eb-3d24-4ccd-a3b9-92a804cf90c4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:19.368282 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d39a5eb-3d24-4ccd-a3b9-92a804cf90c4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:19.497487 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1d39a5eb-3d24-4ccd-a3b9-92a804cf90c4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:19.505647 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1d39a5eb-3d24-4ccd-a3b9-92a804cf90c4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:19.507123 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1d39a5eb-3d24-4ccd-a3b9-92a804cf90c4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:19.508227 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1d39a5eb-3d24-4ccd-a3b9-92a804cf90c4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1406 microversion: 2.20 time: 0.152430 Dec 27 14:29:19.508782 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 510/1048] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:29:19 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:29:20.255715 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c2827ece-472c-4f0f-8779-292259957105 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:20.256673 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c2827ece-472c-4f0f-8779-292259957105 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:20.263553 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c2827ece-472c-4f0f-8779-292259957105 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:20.264042 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c2827ece-472c-4f0f-8779-292259957105 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:20.264827 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c2827ece-472c-4f0f-8779-292259957105 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:20.265269 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c2827ece-472c-4f0f-8779-292259957105 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:20.327092 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c2827ece-472c-4f0f-8779-292259957105 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 14 microversion: 2.1 time: 0.075377 Dec 27 14:29:20.327743 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 539/1049] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:20 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 27 14:29:20.526140 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3008b443-569c-461e-abcc-a569a69bee15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:20.526670 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3008b443-569c-461e-abcc-a569a69bee15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:20.534136 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3008b443-569c-461e-abcc-a569a69bee15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:20.534587 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3008b443-569c-461e-abcc-a569a69bee15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:20.535371 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3008b443-569c-461e-abcc-a569a69bee15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:20.535846 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3008b443-569c-461e-abcc-a569a69bee15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:20.664540 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3008b443-569c-461e-abcc-a569a69bee15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:20.672144 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3008b443-569c-461e-abcc-a569a69bee15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:20.673614 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3008b443-569c-461e-abcc-a569a69bee15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:20.674687 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3008b443-569c-461e-abcc-a569a69bee15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1406 microversion: 2.20 time: 0.152294 Dec 27 14:29:20.675251 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 511/1050] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:29:20 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:29:21.300473 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-28378837-1ceb-4af2-b06d-953014625124 req-ed868791-eb3a-4a06-9027-c54228b344e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f23091f-27bc-4397-ad23-c7aeafafb970", "name": "network-vif-plugged", "status": "completed", "tag": "d5856f9b-e239-4613-88a7-d15a19d0765d"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:21.301953 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:29:21.301953 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:29:21.310168 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-28378837-1ceb-4af2-b06d-953014625124 req-ed868791-eb3a-4a06-9027-c54228b344e3 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:21.310826 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-28378837-1ceb-4af2-b06d-953014625124 req-ed868791-eb3a-4a06-9027-c54228b344e3 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:21.322464 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-28378837-1ceb-4af2-b06d-953014625124 req-ed868791-eb3a-4a06-9027-c54228b344e3 service nova] Creating event network-vif-plugged:d5856f9b-e239-4613-88a7-d15a19d0765d for instance 5f23091f-27bc-4397-ad23-c7aeafafb970 on hv-cinder-82301 Dec 27 14:29:21.327362 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-28378837-1ceb-4af2-b06d-953014625124 req-ed868791-eb3a-4a06-9027-c54228b344e3 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030879 Dec 27 14:29:21.328571 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 540/1051] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:29:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:29:21.336994 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-df8c3df6-d060-4cf8-b770-ee6260a0a9e8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:21.337963 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-df8c3df6-d060-4cf8-b770-ee6260a0a9e8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:21.344212 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df8c3df6-d060-4cf8-b770-ee6260a0a9e8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:21.344665 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df8c3df6-d060-4cf8-b770-ee6260a0a9e8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:21.345506 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df8c3df6-d060-4cf8-b770-ee6260a0a9e8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:21.345936 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df8c3df6-d060-4cf8-b770-ee6260a0a9e8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:21.414510 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-df8c3df6-d060-4cf8-b770-ee6260a0a9e8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 14 microversion: 2.1 time: 0.081118 Dec 27 14:29:21.415150 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 512/1052] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:21 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 27 14:29:21.693741 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0a419829-c1f7-498e-b809-653ab4b4c207 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:21.694448 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0a419829-c1f7-498e-b809-653ab4b4c207 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:21.700541 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0a419829-c1f7-498e-b809-653ab4b4c207 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:21.701117 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0a419829-c1f7-498e-b809-653ab4b4c207 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:21.701768 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0a419829-c1f7-498e-b809-653ab4b4c207 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:21.702211 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0a419829-c1f7-498e-b809-653ab4b4c207 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:21.834396 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0a419829-c1f7-498e-b809-653ab4b4c207 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:21.842120 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0a419829-c1f7-498e-b809-653ab4b4c207 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:21.844184 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0a419829-c1f7-498e-b809-653ab4b4c207 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:21.845280 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0a419829-c1f7-498e-b809-653ab4b4c207 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1406 microversion: 2.20 time: 0.156153 Dec 27 14:29:21.845847 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 541/1053] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:29:21 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:29:22.426730 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-aa6f1ce6-6544-4dc3-8481-829485e6e5f1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:22.427673 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-aa6f1ce6-6544-4dc3-8481-829485e6e5f1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:22.434507 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aa6f1ce6-6544-4dc3-8481-829485e6e5f1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:22.434950 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aa6f1ce6-6544-4dc3-8481-829485e6e5f1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:22.435720 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aa6f1ce6-6544-4dc3-8481-829485e6e5f1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:22.436174 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aa6f1ce6-6544-4dc3-8481-829485e6e5f1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:22.505093 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-aa6f1ce6-6544-4dc3-8481-829485e6e5f1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 14 microversion: 2.1 time: 0.082555 Dec 27 14:29:22.505690 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 513/1054] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:22 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 27 14:29:22.863224 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ae50b46a-16c1-4db0-aa5e-7cdc4d6e2404 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:22.863879 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ae50b46a-16c1-4db0-aa5e-7cdc4d6e2404 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:22.870203 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ae50b46a-16c1-4db0-aa5e-7cdc4d6e2404 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:22.870648 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ae50b46a-16c1-4db0-aa5e-7cdc4d6e2404 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:22.871429 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ae50b46a-16c1-4db0-aa5e-7cdc4d6e2404 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:22.871881 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ae50b46a-16c1-4db0-aa5e-7cdc4d6e2404 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:23.002000 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ae50b46a-16c1-4db0-aa5e-7cdc4d6e2404 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:23.009708 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ae50b46a-16c1-4db0-aa5e-7cdc4d6e2404 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:23.011178 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ae50b46a-16c1-4db0-aa5e-7cdc4d6e2404 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:23.012294 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ae50b46a-16c1-4db0-aa5e-7cdc4d6e2404 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1406 microversion: 2.20 time: 0.153408 Dec 27 14:29:23.012873 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 542/1055] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:29:22 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:29:23.516282 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-57a5a95a-e59a-43d2-b766-98c97916e985 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:23.517276 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-57a5a95a-e59a-43d2-b766-98c97916e985 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:23.524155 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-57a5a95a-e59a-43d2-b766-98c97916e985 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:23.524601 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-57a5a95a-e59a-43d2-b766-98c97916e985 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:23.525373 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-57a5a95a-e59a-43d2-b766-98c97916e985 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:23.525802 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-57a5a95a-e59a-43d2-b766-98c97916e985 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:23.586673 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-57a5a95a-e59a-43d2-b766-98c97916e985 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 14 microversion: 2.1 time: 0.074855 Dec 27 14:29:23.587438 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 514/1056] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:23 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 27 14:29:24.031715 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d4634d53-de74-4653-8840-6c671b8aa1e7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:24.032341 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d4634d53-de74-4653-8840-6c671b8aa1e7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:24.038917 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d4634d53-de74-4653-8840-6c671b8aa1e7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:24.039411 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d4634d53-de74-4653-8840-6c671b8aa1e7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:24.040212 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d4634d53-de74-4653-8840-6c671b8aa1e7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:24.040649 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d4634d53-de74-4653-8840-6c671b8aa1e7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:24.169177 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d4634d53-de74-4653-8840-6c671b8aa1e7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:24.177572 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d4634d53-de74-4653-8840-6c671b8aa1e7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:24.179069 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d4634d53-de74-4653-8840-6c671b8aa1e7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:29:24.180256 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d4634d53-de74-4653-8840-6c671b8aa1e7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1599 microversion: 2.20 time: 0.153066 Dec 27 14:29:24.180822 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 543/1057] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:29:24 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:29:24.197527 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-aab37568-e51a-465e-90cc-803ec671ebc3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:29:24.198104 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-aab37568-e51a-465e-90cc-803ec671ebc3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:24.205514 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aab37568-e51a-465e-90cc-803ec671ebc3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:24.206087 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aab37568-e51a-465e-90cc-803ec671ebc3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:24.206727 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aab37568-e51a-465e-90cc-803ec671ebc3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:24.207159 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aab37568-e51a-465e-90cc-803ec671ebc3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:24.287357 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-aab37568-e51a-465e-90cc-803ec671ebc3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093861 Dec 27 14:29:24.287990 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 515/1058] 10.222.0.37 () {60 vars in 1315 bytes} [Mon Dec 27 14:29:24 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:29:24.598276 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-31c1963a-3549-4567-a495-83582ce465fe tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:24.599106 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-31c1963a-3549-4567-a495-83582ce465fe tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:24.606018 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31c1963a-3549-4567-a495-83582ce465fe tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:24.606462 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31c1963a-3549-4567-a495-83582ce465fe tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:24.607305 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31c1963a-3549-4567-a495-83582ce465fe tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:24.607743 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-31c1963a-3549-4567-a495-83582ce465fe tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:24.668978 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-31c1963a-3549-4567-a495-83582ce465fe tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 14 microversion: 2.1 time: 0.074215 Dec 27 14:29:24.672774 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 544/1059] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:24 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 27 14:29:25.540451 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8ac4e58a-0cca-4b9e-95f0-4e649675d583 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:25.541379 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8ac4e58a-0cca-4b9e-95f0-4e649675d583 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:25.542924 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-82283253-d561-4ce4-bcff-e7cb59f5644a req-03e3dc38-67e6-4b05-84de-89f862bedaab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f23091f-27bc-4397-ad23-c7aeafafb970", "tag": "d5856f9b-e239-4613-88a7-d15a19d0765d"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:25.545055 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:29:25.545055 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:29:25.548039 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ac4e58a-0cca-4b9e-95f0-4e649675d583 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:25.548501 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ac4e58a-0cca-4b9e-95f0-4e649675d583 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:25.549301 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ac4e58a-0cca-4b9e-95f0-4e649675d583 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:25.549918 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ac4e58a-0cca-4b9e-95f0-4e649675d583 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:25.554624 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-82283253-d561-4ce4-bcff-e7cb59f5644a req-03e3dc38-67e6-4b05-84de-89f862bedaab service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:25.554624 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-82283253-d561-4ce4-bcff-e7cb59f5644a req-03e3dc38-67e6-4b05-84de-89f862bedaab service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:25.567339 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-82283253-d561-4ce4-bcff-e7cb59f5644a req-03e3dc38-67e6-4b05-84de-89f862bedaab service nova] Creating event network-changed:d5856f9b-e239-4613-88a7-d15a19d0765d for instance 5f23091f-27bc-4397-ad23-c7aeafafb970 on hv-cinder-82301 Dec 27 14:29:25.572601 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-82283253-d561-4ce4-bcff-e7cb59f5644a req-03e3dc38-67e6-4b05-84de-89f862bedaab service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033817 Dec 27 14:29:25.573274 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 545/1060] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:29:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:29:25.681073 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1c0df84f-39ab-497f-9990-4566c35960eb tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:25.682087 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1c0df84f-39ab-497f-9990-4566c35960eb tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:25.690462 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1c0df84f-39ab-497f-9990-4566c35960eb tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:25.692521 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1c0df84f-39ab-497f-9990-4566c35960eb tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:25.694160 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1c0df84f-39ab-497f-9990-4566c35960eb tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:25.694868 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1c0df84f-39ab-497f-9990-4566c35960eb tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:25.763568 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1c0df84f-39ab-497f-9990-4566c35960eb tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 14 microversion: 2.1 time: 0.086333 Dec 27 14:29:25.765363 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 546/1061] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:25 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 27 14:29:25.784722 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8ac4e58a-0cca-4b9e-95f0-4e649675d583 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 14 microversion: 2.20 time: 0.248478 Dec 27 14:29:25.785699 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 516/1062] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:25 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 14 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:29:26.776322 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-386b1d72-a0d3-412d-ad47-dbe74a49af15 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:26.777333 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-386b1d72-a0d3-412d-ad47-dbe74a49af15 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:26.785306 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-386b1d72-a0d3-412d-ad47-dbe74a49af15 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:26.785759 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-386b1d72-a0d3-412d-ad47-dbe74a49af15 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:26.786542 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-386b1d72-a0d3-412d-ad47-dbe74a49af15 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:26.786973 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-386b1d72-a0d3-412d-ad47-dbe74a49af15 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:26.796085 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-caabdaa1-8d6c-4b3d-ac0d-a7c4c92da00e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:26.797697 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-caabdaa1-8d6c-4b3d-ac0d-a7c4c92da00e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:26.805809 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-caabdaa1-8d6c-4b3d-ac0d-a7c4c92da00e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:26.806151 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-caabdaa1-8d6c-4b3d-ac0d-a7c4c92da00e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:26.806939 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-caabdaa1-8d6c-4b3d-ac0d-a7c4c92da00e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:26.807371 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-caabdaa1-8d6c-4b3d-ac0d-a7c4c92da00e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:26.849124 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-386b1d72-a0d3-412d-ad47-dbe74a49af15 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 14 microversion: 2.1 time: 0.076772 Dec 27 14:29:26.849782 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 547/1063] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:26 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 27 14:29:26.867561 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-caabdaa1-8d6c-4b3d-ac0d-a7c4c92da00e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 14 microversion: 2.20 time: 0.075584 Dec 27 14:29:26.868200 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 517/1064] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:26 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:29:27.860461 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4dd59030-4a62-4177-bd25-454aff9c6f30 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:27.861453 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4dd59030-4a62-4177-bd25-454aff9c6f30 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:27.868569 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4dd59030-4a62-4177-bd25-454aff9c6f30 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:27.869014 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4dd59030-4a62-4177-bd25-454aff9c6f30 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:27.869789 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4dd59030-4a62-4177-bd25-454aff9c6f30 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:27.870219 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4dd59030-4a62-4177-bd25-454aff9c6f30 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:27.879234 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-16c10edb-c3b5-4247-850b-598b494032e8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:27.880260 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-16c10edb-c3b5-4247-850b-598b494032e8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:27.886979 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16c10edb-c3b5-4247-850b-598b494032e8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:27.887444 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16c10edb-c3b5-4247-850b-598b494032e8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:27.888276 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16c10edb-c3b5-4247-850b-598b494032e8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:27.889488 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-16c10edb-c3b5-4247-850b-598b494032e8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:27.973694 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4dd59030-4a62-4177-bd25-454aff9c6f30 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 14 microversion: 2.1 time: 0.117214 Dec 27 14:29:27.976931 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 548/1065] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:27 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 27 14:29:27.989308 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-16c10edb-c3b5-4247-850b-598b494032e8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 14 microversion: 2.20 time: 0.113936 Dec 27 14:29:27.990055 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 518/1066] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:27 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:29:28.985381 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-20d87417-0d7d-4e74-9cfb-f681dddbb379 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:28.986292 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-20d87417-0d7d-4e74-9cfb-f681dddbb379 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:28.993222 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20d87417-0d7d-4e74-9cfb-f681dddbb379 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:28.993672 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20d87417-0d7d-4e74-9cfb-f681dddbb379 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:28.994443 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20d87417-0d7d-4e74-9cfb-f681dddbb379 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:28.994874 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20d87417-0d7d-4e74-9cfb-f681dddbb379 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:29.001052 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5145dd6a-087a-421d-b6fe-279c97a1c235 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:29.002059 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5145dd6a-087a-421d-b6fe-279c97a1c235 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:29.008934 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5145dd6a-087a-421d-b6fe-279c97a1c235 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:29.009388 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5145dd6a-087a-421d-b6fe-279c97a1c235 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:29.010173 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5145dd6a-087a-421d-b6fe-279c97a1c235 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:29.010609 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5145dd6a-087a-421d-b6fe-279c97a1c235 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:29.085780 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-20d87417-0d7d-4e74-9cfb-f681dddbb379 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 10414 microversion: 2.1 time: 0.104991 Dec 27 14:29:29.086411 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 549/1067] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:28 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 10414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:29:29.091228 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5145dd6a-087a-421d-b6fe-279c97a1c235 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 14 microversion: 2.20 time: 0.094660 Dec 27 14:29:29.091916 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 519/1068] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:28 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:29:30.097699 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-78e13942-249c-4102-8eea-4da25bf69b0d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:30.098760 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-78e13942-249c-4102-8eea-4da25bf69b0d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:30.103540 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ce662942-ff5a-443b-af4b-ccc7bf685dca tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:30.104567 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ce662942-ff5a-443b-af4b-ccc7bf685dca tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:30.105741 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-78e13942-249c-4102-8eea-4da25bf69b0d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:30.106193 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-78e13942-249c-4102-8eea-4da25bf69b0d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:30.106977 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-78e13942-249c-4102-8eea-4da25bf69b0d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:30.107419 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-78e13942-249c-4102-8eea-4da25bf69b0d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:30.111311 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce662942-ff5a-443b-af4b-ccc7bf685dca tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:30.111760 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce662942-ff5a-443b-af4b-ccc7bf685dca tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:30.112565 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce662942-ff5a-443b-af4b-ccc7bf685dca tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:30.112997 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ce662942-ff5a-443b-af4b-ccc7bf685dca tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:30.181623 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ce662942-ff5a-443b-af4b-ccc7bf685dca tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 14 microversion: 2.20 time: 0.082446 Dec 27 14:29:30.182245 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 520/1069] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:30 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:29:30.199408 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-78e13942-249c-4102-8eea-4da25bf69b0d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 16983 microversion: 2.1 time: 0.105801 Dec 27 14:29:30.200083 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 550/1070] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:30 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 16983 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:29:31.194331 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ad0a408f-5871-420f-a7d7-a153a423702a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:31.195334 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ad0a408f-5871-420f-a7d7-a153a423702a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:31.202834 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad0a408f-5871-420f-a7d7-a153a423702a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:31.203284 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad0a408f-5871-420f-a7d7-a153a423702a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:31.204097 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad0a408f-5871-420f-a7d7-a153a423702a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:31.204536 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ad0a408f-5871-420f-a7d7-a153a423702a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:31.213347 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6f0e52ff-6b7c-404d-9eed-248a72dd9980 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:31.214365 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6f0e52ff-6b7c-404d-9eed-248a72dd9980 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:31.221902 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6f0e52ff-6b7c-404d-9eed-248a72dd9980 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:31.222349 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6f0e52ff-6b7c-404d-9eed-248a72dd9980 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:31.223145 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6f0e52ff-6b7c-404d-9eed-248a72dd9980 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:31.223563 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6f0e52ff-6b7c-404d-9eed-248a72dd9980 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:31.269508 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ad0a408f-5871-420f-a7d7-a153a423702a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 14 microversion: 2.20 time: 0.080112 Dec 27 14:29:31.270141 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 521/1071] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:31 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:29:31.306739 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6f0e52ff-6b7c-404d-9eed-248a72dd9980 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 18305 microversion: 2.1 time: 0.098272 Dec 27 14:29:31.307365 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 551/1072] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:31 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 18305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:29:32.284103 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-73c2c5e9-5e27-418e-b611-5d00ac242134 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:32.289589 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-73c2c5e9-5e27-418e-b611-5d00ac242134 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:32.297082 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-73c2c5e9-5e27-418e-b611-5d00ac242134 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:32.297534 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-73c2c5e9-5e27-418e-b611-5d00ac242134 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:32.298321 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-73c2c5e9-5e27-418e-b611-5d00ac242134 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:32.298757 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-73c2c5e9-5e27-418e-b611-5d00ac242134 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:32.318394 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e997ae22-96c8-4739-9f33-134dcc3d8043 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:32.319553 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e997ae22-96c8-4739-9f33-134dcc3d8043 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:32.326400 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e997ae22-96c8-4739-9f33-134dcc3d8043 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:32.326873 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e997ae22-96c8-4739-9f33-134dcc3d8043 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:32.327738 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e997ae22-96c8-4739-9f33-134dcc3d8043 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:32.328224 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e997ae22-96c8-4739-9f33-134dcc3d8043 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:32.373944 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-73c2c5e9-5e27-418e-b611-5d00ac242134 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 14 microversion: 2.20 time: 0.096810 Dec 27 14:29:32.374739 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 522/1073] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:32 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:29:32.405823 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e997ae22-96c8-4739-9f33-134dcc3d8043 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 20997 microversion: 2.1 time: 0.090668 Dec 27 14:29:32.406441 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 552/1074] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:32 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 20997 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:29:33.384435 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-03dae6e3-7f67-43b1-aaa4-cc7d6c26e89d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:33.385446 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-03dae6e3-7f67-43b1-aaa4-cc7d6c26e89d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:33.393006 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03dae6e3-7f67-43b1-aaa4-cc7d6c26e89d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:33.393457 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03dae6e3-7f67-43b1-aaa4-cc7d6c26e89d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:33.394251 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03dae6e3-7f67-43b1-aaa4-cc7d6c26e89d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:33.394688 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03dae6e3-7f67-43b1-aaa4-cc7d6c26e89d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:33.417367 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a8571c2b-81a4-473d-9854-a3925ed48822 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:33.418527 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a8571c2b-81a4-473d-9854-a3925ed48822 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:33.426464 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a8571c2b-81a4-473d-9854-a3925ed48822 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:33.426908 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a8571c2b-81a4-473d-9854-a3925ed48822 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:33.427689 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a8571c2b-81a4-473d-9854-a3925ed48822 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:33.428157 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a8571c2b-81a4-473d-9854-a3925ed48822 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:33.457831 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-03dae6e3-7f67-43b1-aaa4-cc7d6c26e89d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 14 microversion: 2.20 time: 0.077268 Dec 27 14:29:33.460855 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 523/1075] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:33 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:29:33.500715 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a8571c2b-81a4-473d-9854-a3925ed48822 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 22981 microversion: 2.1 time: 0.087098 Dec 27 14:29:33.504441 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 553/1076] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:33 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 22981 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:29:34.469603 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e17f170c-2252-4b79-937b-8dbef71d10ec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:34.470625 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e17f170c-2252-4b79-937b-8dbef71d10ec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:34.477406 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e17f170c-2252-4b79-937b-8dbef71d10ec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:34.477856 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e17f170c-2252-4b79-937b-8dbef71d10ec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:34.478659 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e17f170c-2252-4b79-937b-8dbef71d10ec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:34.479097 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e17f170c-2252-4b79-937b-8dbef71d10ec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:34.512144 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4d0df8ab-ea00-44ea-a2ca-fed46fdc317f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:34.513178 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4d0df8ab-ea00-44ea-a2ca-fed46fdc317f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:34.520084 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4d0df8ab-ea00-44ea-a2ca-fed46fdc317f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:34.520541 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4d0df8ab-ea00-44ea-a2ca-fed46fdc317f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:34.521325 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4d0df8ab-ea00-44ea-a2ca-fed46fdc317f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:34.521759 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4d0df8ab-ea00-44ea-a2ca-fed46fdc317f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:34.540414 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e17f170c-2252-4b79-937b-8dbef71d10ec tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 14 microversion: 2.20 time: 0.075156 Dec 27 14:29:34.543496 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 524/1077] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:34 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:29:34.596764 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4d0df8ab-ea00-44ea-a2ca-fed46fdc317f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 23804 microversion: 2.1 time: 0.088531 Dec 27 14:29:34.597382 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 554/1078] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:34 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 23804 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:29:35.551798 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e62d95e4-0394-4e22-86cd-777ba3bf8edc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:35.552828 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e62d95e4-0394-4e22-86cd-777ba3bf8edc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:35.559642 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e62d95e4-0394-4e22-86cd-777ba3bf8edc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:35.560120 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e62d95e4-0394-4e22-86cd-777ba3bf8edc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:35.560897 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e62d95e4-0394-4e22-86cd-777ba3bf8edc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:35.561873 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e62d95e4-0394-4e22-86cd-777ba3bf8edc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:35.609148 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-cd574c32-a043-42a8-bc79-c431e0f2d066 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:35.610157 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-cd574c32-a043-42a8-bc79-c431e0f2d066 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:35.617060 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cd574c32-a043-42a8-bc79-c431e0f2d066 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:35.617516 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cd574c32-a043-42a8-bc79-c431e0f2d066 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:35.618299 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cd574c32-a043-42a8-bc79-c431e0f2d066 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:35.618739 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cd574c32-a043-42a8-bc79-c431e0f2d066 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:35.624897 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e62d95e4-0394-4e22-86cd-777ba3bf8edc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 14 microversion: 2.20 time: 0.076157 Dec 27 14:29:35.628051 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 525/1079] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:35 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:29:35.694451 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-cd574c32-a043-42a8-bc79-c431e0f2d066 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 25313 microversion: 2.1 time: 0.089727 Dec 27 14:29:35.695317 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 555/1080] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:35 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 25313 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:29:36.636261 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-52e50791-9749-453e-8832-ffa9a0937519 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:36.637295 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-52e50791-9749-453e-8832-ffa9a0937519 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:36.644818 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-52e50791-9749-453e-8832-ffa9a0937519 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:36.645312 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-52e50791-9749-453e-8832-ffa9a0937519 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:36.646111 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-52e50791-9749-453e-8832-ffa9a0937519 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:36.646547 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-52e50791-9749-453e-8832-ffa9a0937519 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:36.707015 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7fb2d057-0381-4b57-9a18-6a1e61923468 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:36.708095 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7fb2d057-0381-4b57-9a18-6a1e61923468 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:36.714895 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7fb2d057-0381-4b57-9a18-6a1e61923468 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:36.715345 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7fb2d057-0381-4b57-9a18-6a1e61923468 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:36.716222 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7fb2d057-0381-4b57-9a18-6a1e61923468 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:36.716600 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7fb2d057-0381-4b57-9a18-6a1e61923468 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:36.720517 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-52e50791-9749-453e-8832-ffa9a0937519 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 8992 microversion: 2.20 time: 0.088200 Dec 27 14:29:36.724059 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 526/1081] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:36 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 8992 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:29:36.826099 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7fb2d057-0381-4b57-9a18-6a1e61923468 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 26572 microversion: 2.1 time: 0.122977 Dec 27 14:29:36.827316 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 556/1082] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:36 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 26572 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:29:37.732423 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-85c9d558-543c-4883-9dab-55ad994f426d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:37.733459 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-85c9d558-543c-4883-9dab-55ad994f426d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:37.741088 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85c9d558-543c-4883-9dab-55ad994f426d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:37.741538 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85c9d558-543c-4883-9dab-55ad994f426d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:37.742317 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85c9d558-543c-4883-9dab-55ad994f426d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:37.742752 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-85c9d558-543c-4883-9dab-55ad994f426d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:37.812267 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-85c9d558-543c-4883-9dab-55ad994f426d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 16123 microversion: 2.20 time: 0.083862 Dec 27 14:29:37.812870 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 527/1083] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:37 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 16123 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:29:37.838863 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c1cdc4d5-5ede-4444-9904-e33f62d867d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:37.839888 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c1cdc4d5-5ede-4444-9904-e33f62d867d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:37.847385 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c1cdc4d5-5ede-4444-9904-e33f62d867d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:37.847851 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c1cdc4d5-5ede-4444-9904-e33f62d867d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:37.848639 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c1cdc4d5-5ede-4444-9904-e33f62d867d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:37.849071 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c1cdc4d5-5ede-4444-9904-e33f62d867d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:37.927509 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c1cdc4d5-5ede-4444-9904-e33f62d867d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 27553 microversion: 2.1 time: 0.092722 Dec 27 14:29:37.928168 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 557/1084] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:37 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 27553 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:29:38.823994 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8f1fbe46-76ed-4a69-b169-4db0d8a0d8fa tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:38.824993 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8f1fbe46-76ed-4a69-b169-4db0d8a0d8fa tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:38.832538 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8f1fbe46-76ed-4a69-b169-4db0d8a0d8fa tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:38.832990 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8f1fbe46-76ed-4a69-b169-4db0d8a0d8fa tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:38.833773 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8f1fbe46-76ed-4a69-b169-4db0d8a0d8fa tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:38.834208 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8f1fbe46-76ed-4a69-b169-4db0d8a0d8fa tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:38.918013 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8f1fbe46-76ed-4a69-b169-4db0d8a0d8fa tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 18608 microversion: 2.20 time: 0.098012 Dec 27 14:29:38.918635 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 528/1085] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:38 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 18608 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:29:38.938889 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-87e6c4f0-53bb-4c39-a67e-9a273a3b7c3e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:38.940142 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-87e6c4f0-53bb-4c39-a67e-9a273a3b7c3e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:38.947286 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-87e6c4f0-53bb-4c39-a67e-9a273a3b7c3e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:38.947734 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-87e6c4f0-53bb-4c39-a67e-9a273a3b7c3e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:38.948561 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-87e6c4f0-53bb-4c39-a67e-9a273a3b7c3e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:38.948991 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-87e6c4f0-53bb-4c39-a67e-9a273a3b7c3e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:39.023538 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-87e6c4f0-53bb-4c39-a67e-9a273a3b7c3e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 27856 microversion: 2.1 time: 0.088586 Dec 27 14:29:39.024452 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 558/1086] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:38 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 27856 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:29:39.930178 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-db0e4c1f-ad73-4199-98cd-fb65e5429fa5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:39.931198 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-db0e4c1f-ad73-4199-98cd-fb65e5429fa5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:39.938220 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db0e4c1f-ad73-4199-98cd-fb65e5429fa5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:39.938668 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db0e4c1f-ad73-4199-98cd-fb65e5429fa5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:39.939437 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db0e4c1f-ad73-4199-98cd-fb65e5429fa5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:39.939889 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db0e4c1f-ad73-4199-98cd-fb65e5429fa5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:40.015134 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-db0e4c1f-ad73-4199-98cd-fb65e5429fa5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 20195 microversion: 2.20 time: 0.088602 Dec 27 14:29:40.015553 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 529/1087] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:39 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 20195 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:29:40.035944 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-758c0760-76c9-4a00-99f8-8f6fc1455655 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:40.037051 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-758c0760-76c9-4a00-99f8-8f6fc1455655 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:40.044147 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-758c0760-76c9-4a00-99f8-8f6fc1455655 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:40.044595 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-758c0760-76c9-4a00-99f8-8f6fc1455655 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:40.045375 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-758c0760-76c9-4a00-99f8-8f6fc1455655 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:40.045806 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-758c0760-76c9-4a00-99f8-8f6fc1455655 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:40.126236 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-758c0760-76c9-4a00-99f8-8f6fc1455655 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28167 microversion: 2.1 time: 0.094152 Dec 27 14:29:40.126876 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 559/1088] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:40 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28167 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:29:41.026814 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-15f2f8dd-b82d-4b4e-8fa2-7aad34f95059 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:41.027811 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-15f2f8dd-b82d-4b4e-8fa2-7aad34f95059 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:41.035589 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15f2f8dd-b82d-4b4e-8fa2-7aad34f95059 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:41.036082 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15f2f8dd-b82d-4b4e-8fa2-7aad34f95059 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:41.036869 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15f2f8dd-b82d-4b4e-8fa2-7aad34f95059 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:41.037302 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-15f2f8dd-b82d-4b4e-8fa2-7aad34f95059 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:41.111851 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-15f2f8dd-b82d-4b4e-8fa2-7aad34f95059 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 22770 microversion: 2.20 time: 0.088985 Dec 27 14:29:41.112540 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 530/1089] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:41 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 22770 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:29:41.138424 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a3e7d2e6-165e-4be4-a671-4842857581ed tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:41.139430 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a3e7d2e6-165e-4be4-a671-4842857581ed tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:41.147012 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a3e7d2e6-165e-4be4-a671-4842857581ed tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:41.147461 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a3e7d2e6-165e-4be4-a671-4842857581ed tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:41.148280 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a3e7d2e6-165e-4be4-a671-4842857581ed tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:41.148752 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a3e7d2e6-165e-4be4-a671-4842857581ed tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:41.209199 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a3e7d2e6-165e-4be4-a671-4842857581ed tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28167 microversion: 2.1 time: 0.074647 Dec 27 14:29:41.210095 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 560/1090] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:41 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28167 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:29:42.123115 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5ee8e722-5970-4f26-869e-b91ed7aa5267 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:42.124066 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5ee8e722-5970-4f26-869e-b91ed7aa5267 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:42.131725 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5ee8e722-5970-4f26-869e-b91ed7aa5267 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:42.132317 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5ee8e722-5970-4f26-869e-b91ed7aa5267 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:42.133100 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5ee8e722-5970-4f26-869e-b91ed7aa5267 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:42.133533 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5ee8e722-5970-4f26-869e-b91ed7aa5267 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:42.210686 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5ee8e722-5970-4f26-869e-b91ed7aa5267 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 24276 microversion: 2.20 time: 0.091586 Dec 27 14:29:42.211308 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 531/1091] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:42 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 24276 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:29:42.221681 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4154f32e-8fe1-4097-acae-d4ee0da967df tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:42.222687 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4154f32e-8fe1-4097-acae-d4ee0da967df tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:42.229525 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4154f32e-8fe1-4097-acae-d4ee0da967df tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:42.229975 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4154f32e-8fe1-4097-acae-d4ee0da967df tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:42.230750 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4154f32e-8fe1-4097-acae-d4ee0da967df tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:42.231183 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4154f32e-8fe1-4097-acae-d4ee0da967df tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:42.296797 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4154f32e-8fe1-4097-acae-d4ee0da967df tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28167 microversion: 2.1 time: 0.078858 Dec 27 14:29:42.297448 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 561/1092] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:42 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28167 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:29:43.222661 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fb6fc194-ab0c-4354-b610-cb358dd7210a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:43.223655 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fb6fc194-ab0c-4354-b610-cb358dd7210a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:43.230666 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb6fc194-ab0c-4354-b610-cb358dd7210a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:43.231115 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb6fc194-ab0c-4354-b610-cb358dd7210a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:43.231920 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb6fc194-ab0c-4354-b610-cb358dd7210a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:43.232355 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb6fc194-ab0c-4354-b610-cb358dd7210a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:43.308967 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-52cb367e-ce96-40fd-a2e7-9467d3dd7927 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:43.309994 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-52cb367e-ce96-40fd-a2e7-9467d3dd7927 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:43.315702 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fb6fc194-ab0c-4354-b610-cb358dd7210a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 25802 microversion: 2.20 time: 0.097037 Dec 27 14:29:43.319626 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 532/1093] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:43 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 25802 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:29:43.319776 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-52cb367e-ce96-40fd-a2e7-9467d3dd7927 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:43.319776 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-52cb367e-ce96-40fd-a2e7-9467d3dd7927 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:43.319776 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-52cb367e-ce96-40fd-a2e7-9467d3dd7927 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:43.319776 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-52cb367e-ce96-40fd-a2e7-9467d3dd7927 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:43.383160 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-52cb367e-ce96-40fd-a2e7-9467d3dd7927 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28167 microversion: 2.1 time: 0.078120 Dec 27 14:29:43.383888 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 562/1094] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:43 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28167 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:29:44.327324 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-48861b1f-fee9-4be7-9508-7ae5d8b68060 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:44.328495 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-48861b1f-fee9-4be7-9508-7ae5d8b68060 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:44.335352 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48861b1f-fee9-4be7-9508-7ae5d8b68060 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:44.335809 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48861b1f-fee9-4be7-9508-7ae5d8b68060 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:44.336618 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48861b1f-fee9-4be7-9508-7ae5d8b68060 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:44.337058 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-48861b1f-fee9-4be7-9508-7ae5d8b68060 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:44.395048 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f5c353f3-b873-4f28-bb50-dce5860d2e8e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:44.396000 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f5c353f3-b873-4f28-bb50-dce5860d2e8e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:44.402796 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f5c353f3-b873-4f28-bb50-dce5860d2e8e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:44.403249 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f5c353f3-b873-4f28-bb50-dce5860d2e8e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:44.404316 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f5c353f3-b873-4f28-bb50-dce5860d2e8e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:44.404757 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f5c353f3-b873-4f28-bb50-dce5860d2e8e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:44.424045 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-48861b1f-fee9-4be7-9508-7ae5d8b68060 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 27078 microversion: 2.20 time: 0.100577 Dec 27 14:29:44.424801 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 533/1095] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:44 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 27078 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:29:44.482185 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f5c353f3-b873-4f28-bb50-dce5860d2e8e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28167 microversion: 2.1 time: 0.091087 Dec 27 14:29:44.482809 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 563/1096] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:44 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28167 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:29:45.436369 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-17fdeefe-a6a9-4af1-a46b-a6aff52fed3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:45.437315 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-17fdeefe-a6a9-4af1-a46b-a6aff52fed3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:45.444915 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17fdeefe-a6a9-4af1-a46b-a6aff52fed3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:45.445367 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17fdeefe-a6a9-4af1-a46b-a6aff52fed3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:45.446194 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17fdeefe-a6a9-4af1-a46b-a6aff52fed3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:45.446613 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-17fdeefe-a6a9-4af1-a46b-a6aff52fed3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:45.494302 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9a99ce62-d914-4914-a6dd-5b8b4721fd5b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:45.495312 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9a99ce62-d914-4914-a6dd-5b8b4721fd5b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:45.502976 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a99ce62-d914-4914-a6dd-5b8b4721fd5b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:45.503436 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a99ce62-d914-4914-a6dd-5b8b4721fd5b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:45.504250 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a99ce62-d914-4914-a6dd-5b8b4721fd5b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:45.504689 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9a99ce62-d914-4914-a6dd-5b8b4721fd5b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:45.528371 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-17fdeefe-a6a9-4af1-a46b-a6aff52fed3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 27592 microversion: 2.20 time: 0.095935 Dec 27 14:29:45.529332 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 534/1097] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:45 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 27592 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:29:45.564664 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9a99ce62-d914-4914-a6dd-5b8b4721fd5b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28167 microversion: 2.1 time: 0.074219 Dec 27 14:29:45.565310 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 564/1098] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:45 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28167 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:29:46.541342 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8e3ed7c5-f61c-45d6-89d9-ff1b1ae28725 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:46.542381 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8e3ed7c5-f61c-45d6-89d9-ff1b1ae28725 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:46.549882 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8e3ed7c5-f61c-45d6-89d9-ff1b1ae28725 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:46.550338 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8e3ed7c5-f61c-45d6-89d9-ff1b1ae28725 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:46.551125 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8e3ed7c5-f61c-45d6-89d9-ff1b1ae28725 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:46.551564 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8e3ed7c5-f61c-45d6-89d9-ff1b1ae28725 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:46.576694 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-53c437b6-e268-4b2c-b05e-bf7f11085e90 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:46.578289 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-53c437b6-e268-4b2c-b05e-bf7f11085e90 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:46.585324 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-53c437b6-e268-4b2c-b05e-bf7f11085e90 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:46.585780 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-53c437b6-e268-4b2c-b05e-bf7f11085e90 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:46.586571 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-53c437b6-e268-4b2c-b05e-bf7f11085e90 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:46.587015 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-53c437b6-e268-4b2c-b05e-bf7f11085e90 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:46.631313 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8e3ed7c5-f61c-45d6-89d9-ff1b1ae28725 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 27963 microversion: 2.20 time: 0.093911 Dec 27 14:29:46.632302 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 535/1099] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:46 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 27963 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:29:46.667053 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-53c437b6-e268-4b2c-b05e-bf7f11085e90 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28167 microversion: 2.1 time: 0.094265 Dec 27 14:29:46.667792 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 565/1100] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:46 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28167 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:29:47.643347 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c88128b9-795a-47c2-aeb1-ea54ead2d86d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:47.644379 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c88128b9-795a-47c2-aeb1-ea54ead2d86d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:47.651251 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c88128b9-795a-47c2-aeb1-ea54ead2d86d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:47.651706 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c88128b9-795a-47c2-aeb1-ea54ead2d86d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:47.652513 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c88128b9-795a-47c2-aeb1-ea54ead2d86d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:47.652952 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c88128b9-795a-47c2-aeb1-ea54ead2d86d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:47.679245 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-854d4c12-5a48-4515-8984-b64385ecccac tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:47.680273 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-854d4c12-5a48-4515-8984-b64385ecccac tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:47.687003 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-854d4c12-5a48-4515-8984-b64385ecccac tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:47.688147 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-854d4c12-5a48-4515-8984-b64385ecccac tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:47.688936 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-854d4c12-5a48-4515-8984-b64385ecccac tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:47.689368 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-854d4c12-5a48-4515-8984-b64385ecccac tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:47.737751 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c88128b9-795a-47c2-aeb1-ea54ead2d86d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28198 microversion: 2.20 time: 0.098332 Dec 27 14:29:47.738396 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 536/1101] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:47 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28198 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:29:47.763764 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-854d4c12-5a48-4515-8984-b64385ecccac tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28167 microversion: 2.1 time: 0.088341 Dec 27 14:29:47.764427 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 566/1102] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:47 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28167 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:29:48.749240 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dc170e81-ffc8-49c1-b221-e8349fb97f1b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:48.750767 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dc170e81-ffc8-49c1-b221-e8349fb97f1b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:48.757630 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc170e81-ffc8-49c1-b221-e8349fb97f1b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:48.758080 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc170e81-ffc8-49c1-b221-e8349fb97f1b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:48.758859 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc170e81-ffc8-49c1-b221-e8349fb97f1b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:48.759295 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dc170e81-ffc8-49c1-b221-e8349fb97f1b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:48.776136 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a20110ad-a021-4fe1-aa8c-0b7817f162a1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:48.777160 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a20110ad-a021-4fe1-aa8c-0b7817f162a1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:48.784372 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a20110ad-a021-4fe1-aa8c-0b7817f162a1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:48.784817 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a20110ad-a021-4fe1-aa8c-0b7817f162a1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:48.785595 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a20110ad-a021-4fe1-aa8c-0b7817f162a1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:48.786743 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a20110ad-a021-4fe1-aa8c-0b7817f162a1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:48.821851 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dc170e81-ffc8-49c1-b221-e8349fb97f1b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28198 microversion: 2.20 time: 0.076515 Dec 27 14:29:48.822492 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 537/1103] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:48 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28198 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:29:48.853740 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a20110ad-a021-4fe1-aa8c-0b7817f162a1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28167 microversion: 2.1 time: 0.081379 Dec 27 14:29:48.854409 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 567/1104] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:48 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28167 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:29:49.834354 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b89ce5a6-ead8-4d57-ace3-c4c8ab6928e3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:49.835591 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b89ce5a6-ead8-4d57-ace3-c4c8ab6928e3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:49.842391 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b89ce5a6-ead8-4d57-ace3-c4c8ab6928e3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:49.842837 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b89ce5a6-ead8-4d57-ace3-c4c8ab6928e3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:49.844368 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b89ce5a6-ead8-4d57-ace3-c4c8ab6928e3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:49.844809 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b89ce5a6-ead8-4d57-ace3-c4c8ab6928e3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:49.865936 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ce2c3567-b44c-47a2-bb66-6e56ccac1eca tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:49.866945 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ce2c3567-b44c-47a2-bb66-6e56ccac1eca tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:49.873811 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce2c3567-b44c-47a2-bb66-6e56ccac1eca tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:49.874266 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce2c3567-b44c-47a2-bb66-6e56ccac1eca tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:49.875215 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce2c3567-b44c-47a2-bb66-6e56ccac1eca tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:49.875657 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce2c3567-b44c-47a2-bb66-6e56ccac1eca tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:49.905173 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b89ce5a6-ead8-4d57-ace3-c4c8ab6928e3 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28198 microversion: 2.20 time: 0.074629 Dec 27 14:29:49.905814 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 538/1105] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:49 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28198 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:29:49.936592 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ce2c3567-b44c-47a2-bb66-6e56ccac1eca tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28167 microversion: 2.1 time: 0.074522 Dec 27 14:29:49.937177 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 568/1106] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:49 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28167 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:29:50.918350 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-363a05e0-296b-4f03-9746-6640f67df615 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:50.919346 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-363a05e0-296b-4f03-9746-6640f67df615 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:50.927094 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-363a05e0-296b-4f03-9746-6640f67df615 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:50.927547 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-363a05e0-296b-4f03-9746-6640f67df615 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:50.928357 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-363a05e0-296b-4f03-9746-6640f67df615 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:50.928797 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-363a05e0-296b-4f03-9746-6640f67df615 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:50.953845 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-08fb575f-ac4e-4599-98ed-c977c537b145 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:50.954887 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-08fb575f-ac4e-4599-98ed-c977c537b145 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:50.962180 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-08fb575f-ac4e-4599-98ed-c977c537b145 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:50.962798 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-08fb575f-ac4e-4599-98ed-c977c537b145 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:50.963563 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-08fb575f-ac4e-4599-98ed-c977c537b145 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:50.964550 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-08fb575f-ac4e-4599-98ed-c977c537b145 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:50.989904 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-363a05e0-296b-4f03-9746-6640f67df615 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28198 microversion: 2.20 time: 0.075437 Dec 27 14:29:50.991409 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 539/1107] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:50 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:29:51.026914 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-08fb575f-ac4e-4599-98ed-c977c537b145 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28167 microversion: 2.1 time: 0.082204 Dec 27 14:29:51.027542 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 569/1108] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:50 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28167 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:29:52.002859 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-857dbd96-26f1-4de0-b7c2-7c1004d4e5db tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:52.003776 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-857dbd96-26f1-4de0-b7c2-7c1004d4e5db tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:52.010637 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-857dbd96-26f1-4de0-b7c2-7c1004d4e5db tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:52.011083 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-857dbd96-26f1-4de0-b7c2-7c1004d4e5db tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:52.011883 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-857dbd96-26f1-4de0-b7c2-7c1004d4e5db tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:52.012319 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-857dbd96-26f1-4de0-b7c2-7c1004d4e5db tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:52.044191 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5b8754a7-32a7-43c8-bb53-b861e2619169 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:52.045219 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5b8754a7-32a7-43c8-bb53-b861e2619169 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:52.052705 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5b8754a7-32a7-43c8-bb53-b861e2619169 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:52.053156 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5b8754a7-32a7-43c8-bb53-b861e2619169 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:52.053996 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5b8754a7-32a7-43c8-bb53-b861e2619169 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:52.054430 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5b8754a7-32a7-43c8-bb53-b861e2619169 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:52.098632 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-857dbd96-26f1-4de0-b7c2-7c1004d4e5db tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28198 microversion: 2.20 time: 0.100285 Dec 27 14:29:52.099282 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 540/1109] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:51 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28198 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:29:52.128525 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5b8754a7-32a7-43c8-bb53-b861e2619169 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28167 microversion: 2.1 time: 0.089193 Dec 27 14:29:52.129869 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 570/1110] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:52 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28167 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:29:53.110923 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4199cb9b-9883-4968-b814-3548ec1e0e54 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:53.111952 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4199cb9b-9883-4968-b814-3548ec1e0e54 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:53.118788 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4199cb9b-9883-4968-b814-3548ec1e0e54 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:53.119239 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4199cb9b-9883-4968-b814-3548ec1e0e54 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:53.120057 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4199cb9b-9883-4968-b814-3548ec1e0e54 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:53.120492 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4199cb9b-9883-4968-b814-3548ec1e0e54 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:53.141324 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-cc0e8d9f-4a09-4cf6-9da3-de94fe36d389 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:53.142420 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-cc0e8d9f-4a09-4cf6-9da3-de94fe36d389 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:53.150288 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc0e8d9f-4a09-4cf6-9da3-de94fe36d389 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:53.150743 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc0e8d9f-4a09-4cf6-9da3-de94fe36d389 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:53.151535 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc0e8d9f-4a09-4cf6-9da3-de94fe36d389 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:53.151990 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc0e8d9f-4a09-4cf6-9da3-de94fe36d389 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:53.194155 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4199cb9b-9883-4968-b814-3548ec1e0e54 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28198 microversion: 2.20 time: 0.087432 Dec 27 14:29:53.194858 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 541/1111] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:53 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28198 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:29:53.226302 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-cc0e8d9f-4a09-4cf6-9da3-de94fe36d389 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28458 microversion: 2.1 time: 0.089772 Dec 27 14:29:53.226943 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 571/1112] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:53 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28458 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:29:54.207379 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-261ea4dc-9dbb-45bd-9376-7379fd3d7495 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:54.208409 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-261ea4dc-9dbb-45bd-9376-7379fd3d7495 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:54.215234 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-261ea4dc-9dbb-45bd-9376-7379fd3d7495 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:54.215682 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-261ea4dc-9dbb-45bd-9376-7379fd3d7495 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:54.216497 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-261ea4dc-9dbb-45bd-9376-7379fd3d7495 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:54.216950 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-261ea4dc-9dbb-45bd-9376-7379fd3d7495 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:54.238472 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-119d4d1c-615c-408a-80b6-1788341e4400 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:54.239482 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-119d4d1c-615c-408a-80b6-1788341e4400 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:54.246357 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-119d4d1c-615c-408a-80b6-1788341e4400 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:54.246867 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-119d4d1c-615c-408a-80b6-1788341e4400 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:54.247594 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-119d4d1c-615c-408a-80b6-1788341e4400 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:54.248059 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-119d4d1c-615c-408a-80b6-1788341e4400 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:54.290999 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-261ea4dc-9dbb-45bd-9376-7379fd3d7495 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28198 microversion: 2.20 time: 0.088220 Dec 27 14:29:54.291758 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 542/1113] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:54 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28198 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:29:54.314225 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-119d4d1c-615c-408a-80b6-1788341e4400 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28458 microversion: 2.1 time: 0.079838 Dec 27 14:29:54.314866 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 572/1114] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:54 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28458 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:29:55.303140 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a2565724-2d9a-4055-8093-14e2ee3c9927 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:55.304183 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a2565724-2d9a-4055-8093-14e2ee3c9927 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:55.311054 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2565724-2d9a-4055-8093-14e2ee3c9927 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:55.311514 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2565724-2d9a-4055-8093-14e2ee3c9927 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:55.312333 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2565724-2d9a-4055-8093-14e2ee3c9927 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:55.312767 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a2565724-2d9a-4055-8093-14e2ee3c9927 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:55.326050 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-518cb9ad-8536-4d2f-9090-709737ce11d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:55.327047 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-518cb9ad-8536-4d2f-9090-709737ce11d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:55.334422 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-518cb9ad-8536-4d2f-9090-709737ce11d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:55.334871 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-518cb9ad-8536-4d2f-9090-709737ce11d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:55.335650 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-518cb9ad-8536-4d2f-9090-709737ce11d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:55.336089 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-518cb9ad-8536-4d2f-9090-709737ce11d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:55.378034 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a2565724-2d9a-4055-8093-14e2ee3c9927 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28198 microversion: 2.20 time: 0.078820 Dec 27 14:29:55.378683 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 543/1115] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:55 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28198 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:29:55.423037 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-518cb9ad-8536-4d2f-9090-709737ce11d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.100792 Dec 27 14:29:55.423609 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 573/1116] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:55 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:29:56.390125 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fe79ac32-c3f9-40b4-a8ca-79e336100fb4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:56.391285 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fe79ac32-c3f9-40b4-a8ca-79e336100fb4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:56.398221 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fe79ac32-c3f9-40b4-a8ca-79e336100fb4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:56.398613 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fe79ac32-c3f9-40b4-a8ca-79e336100fb4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:56.399395 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fe79ac32-c3f9-40b4-a8ca-79e336100fb4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:56.399849 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fe79ac32-c3f9-40b4-a8ca-79e336100fb4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:56.434632 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ad5b1dc7-b0e9-480b-ac0e-bc15f2e91350 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:56.435649 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ad5b1dc7-b0e9-480b-ac0e-bc15f2e91350 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:56.442533 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ad5b1dc7-b0e9-480b-ac0e-bc15f2e91350 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:56.442983 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ad5b1dc7-b0e9-480b-ac0e-bc15f2e91350 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:56.443755 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ad5b1dc7-b0e9-480b-ac0e-bc15f2e91350 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:56.444217 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ad5b1dc7-b0e9-480b-ac0e-bc15f2e91350 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:56.459496 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fe79ac32-c3f9-40b4-a8ca-79e336100fb4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28198 microversion: 2.20 time: 0.073306 Dec 27 14:29:56.463606 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 544/1117] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:56 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28198 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:29:56.505698 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ad5b1dc7-b0e9-480b-ac0e-bc15f2e91350 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.074942 Dec 27 14:29:56.506359 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 574/1118] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:56 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:29:57.472373 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ed6841ab-9e51-4d30-abbb-7064bd913e43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:57.473414 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ed6841ab-9e51-4d30-abbb-7064bd913e43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:57.480282 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ed6841ab-9e51-4d30-abbb-7064bd913e43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:57.480738 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ed6841ab-9e51-4d30-abbb-7064bd913e43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:57.481518 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ed6841ab-9e51-4d30-abbb-7064bd913e43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:57.481956 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ed6841ab-9e51-4d30-abbb-7064bd913e43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:57.518463 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-664c47c6-c987-456d-bca4-42bbe64b55e0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:57.519460 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-664c47c6-c987-456d-bca4-42bbe64b55e0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:57.526262 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-664c47c6-c987-456d-bca4-42bbe64b55e0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:57.526712 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-664c47c6-c987-456d-bca4-42bbe64b55e0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:57.527487 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-664c47c6-c987-456d-bca4-42bbe64b55e0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:57.527951 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-664c47c6-c987-456d-bca4-42bbe64b55e0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:57.558913 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ed6841ab-9e51-4d30-abbb-7064bd913e43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28198 microversion: 2.20 time: 0.090803 Dec 27 14:29:57.559815 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 545/1119] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:57 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28198 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:29:57.586958 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-664c47c6-c987-456d-bca4-42bbe64b55e0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.073042 Dec 27 14:29:57.587602 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 575/1120] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:57 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:29:58.570993 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2d9b5e37-2c9a-434d-a0b0-08bad1685df9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:58.572067 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2d9b5e37-2c9a-434d-a0b0-08bad1685df9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:58.579209 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d9b5e37-2c9a-434d-a0b0-08bad1685df9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:58.579669 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d9b5e37-2c9a-434d-a0b0-08bad1685df9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:58.580493 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d9b5e37-2c9a-434d-a0b0-08bad1685df9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:58.580939 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2d9b5e37-2c9a-434d-a0b0-08bad1685df9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:58.599776 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a027122a-ee9c-4682-8373-e7a49dbf8cf8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:58.600801 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a027122a-ee9c-4682-8373-e7a49dbf8cf8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:58.607157 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a027122a-ee9c-4682-8373-e7a49dbf8cf8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:58.607614 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a027122a-ee9c-4682-8373-e7a49dbf8cf8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:58.608438 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a027122a-ee9c-4682-8373-e7a49dbf8cf8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:58.609495 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a027122a-ee9c-4682-8373-e7a49dbf8cf8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:58.647495 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2d9b5e37-2c9a-434d-a0b0-08bad1685df9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28198 microversion: 2.20 time: 0.080438 Dec 27 14:29:58.648424 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 546/1121] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:58 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28198 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:29:58.676208 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a027122a-ee9c-4682-8373-e7a49dbf8cf8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.080759 Dec 27 14:29:58.676847 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 576/1122] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:58 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:29:59.659540 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3c91eecf-c86d-4f39-9915-8842183fa37a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:59.660606 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3c91eecf-c86d-4f39-9915-8842183fa37a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:59.668226 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3c91eecf-c86d-4f39-9915-8842183fa37a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:59.668682 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3c91eecf-c86d-4f39-9915-8842183fa37a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:59.669467 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3c91eecf-c86d-4f39-9915-8842183fa37a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:59.669904 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3c91eecf-c86d-4f39-9915-8842183fa37a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:59.688642 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c75ed631-23bc-453a-a48d-3bb8489768b3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:29:59.689789 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c75ed631-23bc-453a-a48d-3bb8489768b3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:29:59.697639 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c75ed631-23bc-453a-a48d-3bb8489768b3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:59.698070 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c75ed631-23bc-453a-a48d-3bb8489768b3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:59.698852 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c75ed631-23bc-453a-a48d-3bb8489768b3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:29:59.699286 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c75ed631-23bc-453a-a48d-3bb8489768b3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:29:59.744596 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3c91eecf-c86d-4f39-9915-8842183fa37a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28198 microversion: 2.20 time: 0.089163 Dec 27 14:29:59.745240 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 547/1123] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:29:59 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28198 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:29:59.789701 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c75ed631-23bc-453a-a48d-3bb8489768b3 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.105526 Dec 27 14:29:59.790343 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 577/1124] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:29:59 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:30:00.756988 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fdbfbd5e-b531-44b2-923c-90da0ba98fd2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:00.757986 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fdbfbd5e-b531-44b2-923c-90da0ba98fd2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:00.764899 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fdbfbd5e-b531-44b2-923c-90da0ba98fd2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:00.766047 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fdbfbd5e-b531-44b2-923c-90da0ba98fd2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:00.766866 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fdbfbd5e-b531-44b2-923c-90da0ba98fd2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:00.767303 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fdbfbd5e-b531-44b2-923c-90da0ba98fd2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:00.801894 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e95f39cb-e84e-4955-bec8-590935c01d19 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:00.802886 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e95f39cb-e84e-4955-bec8-590935c01d19 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:00.809444 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e95f39cb-e84e-4955-bec8-590935c01d19 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:00.809894 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e95f39cb-e84e-4955-bec8-590935c01d19 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:00.810663 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e95f39cb-e84e-4955-bec8-590935c01d19 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:00.811095 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e95f39cb-e84e-4955-bec8-590935c01d19 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:00.842233 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fdbfbd5e-b531-44b2-923c-90da0ba98fd2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28489 microversion: 2.20 time: 0.089111 Dec 27 14:30:00.843289 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 548/1125] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:00 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28489 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:00.870957 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e95f39cb-e84e-4955-bec8-590935c01d19 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.072848 Dec 27 14:30:00.871594 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 578/1126] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:00 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:30:01.855168 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cd50dab4-47fc-4e89-a5f8-4104a64eec3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:01.856201 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cd50dab4-47fc-4e89-a5f8-4104a64eec3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:01.863056 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd50dab4-47fc-4e89-a5f8-4104a64eec3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:01.863502 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd50dab4-47fc-4e89-a5f8-4104a64eec3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:01.864311 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd50dab4-47fc-4e89-a5f8-4104a64eec3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:01.864743 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cd50dab4-47fc-4e89-a5f8-4104a64eec3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:01.883131 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e80475aa-21b0-49d8-aabc-416ffba1a3f6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:01.884257 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e80475aa-21b0-49d8-aabc-416ffba1a3f6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:01.891939 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e80475aa-21b0-49d8-aabc-416ffba1a3f6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:01.892395 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e80475aa-21b0-49d8-aabc-416ffba1a3f6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:01.893185 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e80475aa-21b0-49d8-aabc-416ffba1a3f6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:01.893624 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e80475aa-21b0-49d8-aabc-416ffba1a3f6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:01.945912 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cd50dab4-47fc-4e89-a5f8-4104a64eec3f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.094568 Dec 27 14:30:01.946806 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 549/1127] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:01 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:01.978053 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e80475aa-21b0-49d8-aabc-416ffba1a3f6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.098990 Dec 27 14:30:01.978618 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 579/1128] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:01 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:30:02.957424 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-572fa1e5-ff42-49a6-a6be-750e452a08d7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:02.958421 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-572fa1e5-ff42-49a6-a6be-750e452a08d7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:02.965269 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-572fa1e5-ff42-49a6-a6be-750e452a08d7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:02.965717 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-572fa1e5-ff42-49a6-a6be-750e452a08d7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:02.966525 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-572fa1e5-ff42-49a6-a6be-750e452a08d7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:02.966952 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-572fa1e5-ff42-49a6-a6be-750e452a08d7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:02.989813 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1b7bc0a8-4dd9-4352-8f5d-39f3b725b5ea tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:02.990907 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1b7bc0a8-4dd9-4352-8f5d-39f3b725b5ea tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:02.997720 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1b7bc0a8-4dd9-4352-8f5d-39f3b725b5ea tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:02.998171 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1b7bc0a8-4dd9-4352-8f5d-39f3b725b5ea tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:02.998956 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1b7bc0a8-4dd9-4352-8f5d-39f3b725b5ea tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:02.999446 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1b7bc0a8-4dd9-4352-8f5d-39f3b725b5ea tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:03.030084 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-572fa1e5-ff42-49a6-a6be-750e452a08d7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.076478 Dec 27 14:30:03.031330 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 550/1129] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:02 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:30:03.067068 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1b7bc0a8-4dd9-4352-8f5d-39f3b725b5ea tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.081017 Dec 27 14:30:03.067713 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 580/1130] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:02 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:30:04.042713 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-eda564f3-0620-494e-b2de-5d6c3965aa3d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:04.043632 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-eda564f3-0620-494e-b2de-5d6c3965aa3d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:04.051255 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eda564f3-0620-494e-b2de-5d6c3965aa3d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:04.051701 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eda564f3-0620-494e-b2de-5d6c3965aa3d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:04.052509 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eda564f3-0620-494e-b2de-5d6c3965aa3d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:04.052943 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-eda564f3-0620-494e-b2de-5d6c3965aa3d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:04.079261 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-033dddf3-14df-48d6-8a14-d63392a7a869 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:04.080316 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-033dddf3-14df-48d6-8a14-d63392a7a869 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:04.087192 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-033dddf3-14df-48d6-8a14-d63392a7a869 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:04.087647 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-033dddf3-14df-48d6-8a14-d63392a7a869 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:04.088477 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-033dddf3-14df-48d6-8a14-d63392a7a869 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:04.088913 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-033dddf3-14df-48d6-8a14-d63392a7a869 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:04.113010 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-eda564f3-0620-494e-b2de-5d6c3965aa3d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.074244 Dec 27 14:30:04.113646 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 551/1131] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:04 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:04.151740 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-033dddf3-14df-48d6-8a14-d63392a7a869 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.076841 Dec 27 14:30:04.152546 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 581/1132] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:04 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:30:05.125449 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-61ffd461-2f66-4e1b-98b5-cc912d417bfe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:05.126482 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-61ffd461-2f66-4e1b-98b5-cc912d417bfe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:05.133458 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61ffd461-2f66-4e1b-98b5-cc912d417bfe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:05.133910 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61ffd461-2f66-4e1b-98b5-cc912d417bfe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:05.134701 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61ffd461-2f66-4e1b-98b5-cc912d417bfe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:05.135139 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61ffd461-2f66-4e1b-98b5-cc912d417bfe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:05.164624 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3001ffa6-bf11-4ce5-9d56-93f5408e4aeb tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:05.165672 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3001ffa6-bf11-4ce5-9d56-93f5408e4aeb tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:05.172367 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3001ffa6-bf11-4ce5-9d56-93f5408e4aeb tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:05.172817 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3001ffa6-bf11-4ce5-9d56-93f5408e4aeb tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:05.173598 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3001ffa6-bf11-4ce5-9d56-93f5408e4aeb tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:05.174036 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3001ffa6-bf11-4ce5-9d56-93f5408e4aeb tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:05.206458 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-61ffd461-2f66-4e1b-98b5-cc912d417bfe tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.084960 Dec 27 14:30:05.207152 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 552/1133] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:05 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:30:05.235474 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3001ffa6-bf11-4ce5-9d56-93f5408e4aeb tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.074642 Dec 27 14:30:05.236164 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 582/1134] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:05 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:30:06.218398 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fa9a0c31-b09b-4196-a784-e70e3fcd8b15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:06.219493 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fa9a0c31-b09b-4196-a784-e70e3fcd8b15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:06.226403 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa9a0c31-b09b-4196-a784-e70e3fcd8b15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:06.226855 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa9a0c31-b09b-4196-a784-e70e3fcd8b15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:06.227641 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa9a0c31-b09b-4196-a784-e70e3fcd8b15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:06.228104 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fa9a0c31-b09b-4196-a784-e70e3fcd8b15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:06.246966 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7779a132-d5f8-480d-8ded-bee572e5bf43 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:06.248043 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7779a132-d5f8-480d-8ded-bee572e5bf43 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:06.255459 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7779a132-d5f8-480d-8ded-bee572e5bf43 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:06.255922 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7779a132-d5f8-480d-8ded-bee572e5bf43 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:06.256753 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7779a132-d5f8-480d-8ded-bee572e5bf43 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:06.257199 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7779a132-d5f8-480d-8ded-bee572e5bf43 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:06.292067 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fa9a0c31-b09b-4196-a784-e70e3fcd8b15 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.078154 Dec 27 14:30:06.292712 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 553/1135] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:06 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:06.318217 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7779a132-d5f8-480d-8ded-bee572e5bf43 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.075167 Dec 27 14:30:06.318854 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 583/1136] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:06 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:30:07.304982 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-83ae33ed-aec6-4da5-8657-7a316a0fbbf1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:07.306012 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-83ae33ed-aec6-4da5-8657-7a316a0fbbf1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:07.313385 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83ae33ed-aec6-4da5-8657-7a316a0fbbf1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:07.313833 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83ae33ed-aec6-4da5-8657-7a316a0fbbf1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:07.314608 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83ae33ed-aec6-4da5-8657-7a316a0fbbf1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:07.315041 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-83ae33ed-aec6-4da5-8657-7a316a0fbbf1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:07.330072 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6a15dac5-bf13-4c86-9db5-31e3111462fa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:07.331067 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6a15dac5-bf13-4c86-9db5-31e3111462fa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:07.338131 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6a15dac5-bf13-4c86-9db5-31e3111462fa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:07.338579 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6a15dac5-bf13-4c86-9db5-31e3111462fa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:07.339360 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6a15dac5-bf13-4c86-9db5-31e3111462fa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:07.339789 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6a15dac5-bf13-4c86-9db5-31e3111462fa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:07.377854 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-83ae33ed-aec6-4da5-8657-7a316a0fbbf1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.076776 Dec 27 14:30:07.378496 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 554/1137] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:07 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:07.410102 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6a15dac5-bf13-4c86-9db5-31e3111462fa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.083948 Dec 27 14:30:07.410674 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 584/1138] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:07 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:30:08.389534 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fc70335b-77d5-4f24-aca3-9084c80c415f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:08.390613 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fc70335b-77d5-4f24-aca3-9084c80c415f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:08.397694 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc70335b-77d5-4f24-aca3-9084c80c415f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:08.398084 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc70335b-77d5-4f24-aca3-9084c80c415f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:08.398881 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc70335b-77d5-4f24-aca3-9084c80c415f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:08.399316 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fc70335b-77d5-4f24-aca3-9084c80c415f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:08.422760 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-361f8fb3-1a5c-4eb1-a191-6b11d02700e9 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:08.423769 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-361f8fb3-1a5c-4eb1-a191-6b11d02700e9 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:08.431423 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-361f8fb3-1a5c-4eb1-a191-6b11d02700e9 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:08.431915 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-361f8fb3-1a5c-4eb1-a191-6b11d02700e9 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:08.432712 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-361f8fb3-1a5c-4eb1-a191-6b11d02700e9 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:08.433152 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-361f8fb3-1a5c-4eb1-a191-6b11d02700e9 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:08.467476 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fc70335b-77d5-4f24-aca3-9084c80c415f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.081994 Dec 27 14:30:08.468699 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 555/1139] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:08 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:08.501154 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-361f8fb3-1a5c-4eb1-a191-6b11d02700e9 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.083157 Dec 27 14:30:08.501814 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 585/1140] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:08 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:30:09.480452 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dee3830a-b058-40fa-8e9c-473536ac542c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:09.481465 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dee3830a-b058-40fa-8e9c-473536ac542c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:09.488992 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dee3830a-b058-40fa-8e9c-473536ac542c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:09.489441 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dee3830a-b058-40fa-8e9c-473536ac542c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:09.490213 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dee3830a-b058-40fa-8e9c-473536ac542c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:09.490643 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dee3830a-b058-40fa-8e9c-473536ac542c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:09.513205 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f1621ce9-a9d6-4739-972d-dbcf770f2b36 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:09.514207 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f1621ce9-a9d6-4739-972d-dbcf770f2b36 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:09.521252 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f1621ce9-a9d6-4739-972d-dbcf770f2b36 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:09.521706 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f1621ce9-a9d6-4739-972d-dbcf770f2b36 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:09.522491 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f1621ce9-a9d6-4739-972d-dbcf770f2b36 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:09.522929 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f1621ce9-a9d6-4739-972d-dbcf770f2b36 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:09.565967 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dee3830a-b058-40fa-8e9c-473536ac542c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.089692 Dec 27 14:30:09.566632 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 556/1141] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:09 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:09.596403 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f1621ce9-a9d6-4739-972d-dbcf770f2b36 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.086944 Dec 27 14:30:09.597049 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 586/1142] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:09 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:30:10.579102 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6143ceef-8b97-49c1-8af4-0b1347b4d55d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:10.580191 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6143ceef-8b97-49c1-8af4-0b1347b4d55d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:10.587306 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6143ceef-8b97-49c1-8af4-0b1347b4d55d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:10.587737 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6143ceef-8b97-49c1-8af4-0b1347b4d55d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:10.588547 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6143ceef-8b97-49c1-8af4-0b1347b4d55d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:10.589026 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6143ceef-8b97-49c1-8af4-0b1347b4d55d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:10.608216 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-85d0687d-a32e-4d2e-8be4-d25ac068fcbd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:10.609283 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-85d0687d-a32e-4d2e-8be4-d25ac068fcbd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:10.617456 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-85d0687d-a32e-4d2e-8be4-d25ac068fcbd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:10.617915 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-85d0687d-a32e-4d2e-8be4-d25ac068fcbd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:10.618707 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-85d0687d-a32e-4d2e-8be4-d25ac068fcbd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:10.619151 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-85d0687d-a32e-4d2e-8be4-d25ac068fcbd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:10.654973 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6143ceef-8b97-49c1-8af4-0b1347b4d55d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.080878 Dec 27 14:30:10.655705 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 557/1143] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:10 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:10.685935 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-85d0687d-a32e-4d2e-8be4-d25ac068fcbd tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.081626 Dec 27 14:30:10.687170 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 587/1144] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:10 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:30:11.667274 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f2d45222-dc43-4995-8657-4576eedb1c9d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:11.668402 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f2d45222-dc43-4995-8657-4576eedb1c9d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:11.676315 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f2d45222-dc43-4995-8657-4576eedb1c9d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:11.676771 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f2d45222-dc43-4995-8657-4576eedb1c9d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:11.677556 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f2d45222-dc43-4995-8657-4576eedb1c9d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:11.677990 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f2d45222-dc43-4995-8657-4576eedb1c9d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:11.697817 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3cb3edd5-462e-493f-8515-d8ad1be60ec8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:11.698806 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3cb3edd5-462e-493f-8515-d8ad1be60ec8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:11.705651 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3cb3edd5-462e-493f-8515-d8ad1be60ec8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:11.706098 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3cb3edd5-462e-493f-8515-d8ad1be60ec8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:11.706880 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3cb3edd5-462e-493f-8515-d8ad1be60ec8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:11.707309 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3cb3edd5-462e-493f-8515-d8ad1be60ec8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:11.747188 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f2d45222-dc43-4995-8657-4576eedb1c9d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.083828 Dec 27 14:30:11.747900 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 558/1145] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:11 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:11.765413 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3cb3edd5-462e-493f-8515-d8ad1be60ec8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.071288 Dec 27 14:30:11.766048 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 588/1146] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:11 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:30:12.759000 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-84b884d3-5886-49e4-ab2b-1fe093832fdc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:12.760114 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-84b884d3-5886-49e4-ab2b-1fe093832fdc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:12.768110 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-84b884d3-5886-49e4-ab2b-1fe093832fdc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:12.768568 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-84b884d3-5886-49e4-ab2b-1fe093832fdc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:12.769353 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-84b884d3-5886-49e4-ab2b-1fe093832fdc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:12.769807 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-84b884d3-5886-49e4-ab2b-1fe093832fdc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:12.779247 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8df8fa3a-41c4-4df8-9a4b-9024d0ded621 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:12.780582 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8df8fa3a-41c4-4df8-9a4b-9024d0ded621 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:12.787528 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8df8fa3a-41c4-4df8-9a4b-9024d0ded621 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:12.788014 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8df8fa3a-41c4-4df8-9a4b-9024d0ded621 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:12.788800 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8df8fa3a-41c4-4df8-9a4b-9024d0ded621 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:12.789239 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8df8fa3a-41c4-4df8-9a4b-9024d0ded621 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:12.842150 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-84b884d3-5886-49e4-ab2b-1fe093832fdc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.087058 Dec 27 14:30:12.842774 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 559/1147] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:12 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:12.847976 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8df8fa3a-41c4-4df8-9a4b-9024d0ded621 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.073668 Dec 27 14:30:12.848605 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 589/1148] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:12 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:30:13.854247 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0d73b4a3-1f6e-45e8-8742-fa24e5e32c84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:13.855184 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0d73b4a3-1f6e-45e8-8742-fa24e5e32c84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:13.859470 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9b378e8b-61fe-44e3-a0e1-7fc35c0d7c03 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:13.860604 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9b378e8b-61fe-44e3-a0e1-7fc35c0d7c03 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:13.862625 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d73b4a3-1f6e-45e8-8742-fa24e5e32c84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:13.863079 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d73b4a3-1f6e-45e8-8742-fa24e5e32c84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:13.863891 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d73b4a3-1f6e-45e8-8742-fa24e5e32c84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:13.864330 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d73b4a3-1f6e-45e8-8742-fa24e5e32c84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:13.867256 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b378e8b-61fe-44e3-a0e1-7fc35c0d7c03 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:13.867708 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b378e8b-61fe-44e3-a0e1-7fc35c0d7c03 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:13.868520 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b378e8b-61fe-44e3-a0e1-7fc35c0d7c03 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:13.868957 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9b378e8b-61fe-44e3-a0e1-7fc35c0d7c03 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:13.926941 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0d73b4a3-1f6e-45e8-8742-fa24e5e32c84 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.076701 Dec 27 14:30:13.927577 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 560/1149] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:13 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:13.931947 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9b378e8b-61fe-44e3-a0e1-7fc35c0d7c03 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.076313 Dec 27 14:30:13.932589 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 590/1150] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:13 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:30:14.939978 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-60326d2a-6902-4669-9219-6337d618241e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:14.941663 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-60326d2a-6902-4669-9219-6337d618241e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:14.943323 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-437abd85-4e5f-4e6c-b26c-b23641665067 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:14.944362 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-437abd85-4e5f-4e6c-b26c-b23641665067 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:14.948695 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60326d2a-6902-4669-9219-6337d618241e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:14.949147 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60326d2a-6902-4669-9219-6337d618241e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:14.949939 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60326d2a-6902-4669-9219-6337d618241e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:14.950373 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-60326d2a-6902-4669-9219-6337d618241e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:14.951062 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-437abd85-4e5f-4e6c-b26c-b23641665067 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:14.951509 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-437abd85-4e5f-4e6c-b26c-b23641665067 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:14.952357 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-437abd85-4e5f-4e6c-b26c-b23641665067 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:14.952981 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-437abd85-4e5f-4e6c-b26c-b23641665067 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:15.014048 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-437abd85-4e5f-4e6c-b26c-b23641665067 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.075124 Dec 27 14:30:15.015342 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 591/1151] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:14 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:30:15.019283 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-60326d2a-6902-4669-9219-6337d618241e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.083872 Dec 27 14:30:15.019958 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 561/1152] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:14 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:16.026930 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-95a3b38d-cf3d-46e7-aa1a-701e0bcfd897 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:16.027963 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-95a3b38d-cf3d-46e7-aa1a-701e0bcfd897 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:16.031391 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1d786689-00f8-4cdc-8042-118166573b7e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:16.032435 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1d786689-00f8-4cdc-8042-118166573b7e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:16.035111 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-95a3b38d-cf3d-46e7-aa1a-701e0bcfd897 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:16.035562 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-95a3b38d-cf3d-46e7-aa1a-701e0bcfd897 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:16.036365 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-95a3b38d-cf3d-46e7-aa1a-701e0bcfd897 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:16.036799 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-95a3b38d-cf3d-46e7-aa1a-701e0bcfd897 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:16.039285 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d786689-00f8-4cdc-8042-118166573b7e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:16.039742 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d786689-00f8-4cdc-8042-118166573b7e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:16.040562 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d786689-00f8-4cdc-8042-118166573b7e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:16.041000 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1d786689-00f8-4cdc-8042-118166573b7e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:16.104797 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-95a3b38d-cf3d-46e7-aa1a-701e0bcfd897 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.081799 Dec 27 14:30:16.105456 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 592/1153] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:16 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:30:16.109946 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1d786689-00f8-4cdc-8042-118166573b7e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.082971 Dec 27 14:30:16.110575 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 562/1154] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:16 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:30:17.117667 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5ff3d4e4-afdc-464f-8bca-193cde53f28e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:17.118668 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5ff3d4e4-afdc-464f-8bca-193cde53f28e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:17.121504 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a059a0d9-2c10-47f6-a12e-f6f44915e985 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:17.122535 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a059a0d9-2c10-47f6-a12e-f6f44915e985 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:17.125837 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5ff3d4e4-afdc-464f-8bca-193cde53f28e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:17.126295 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5ff3d4e4-afdc-464f-8bca-193cde53f28e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:17.127090 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5ff3d4e4-afdc-464f-8bca-193cde53f28e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:17.127528 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5ff3d4e4-afdc-464f-8bca-193cde53f28e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:17.129813 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a059a0d9-2c10-47f6-a12e-f6f44915e985 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:17.130266 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a059a0d9-2c10-47f6-a12e-f6f44915e985 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:17.132201 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a059a0d9-2c10-47f6-a12e-f6f44915e985 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:17.132201 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a059a0d9-2c10-47f6-a12e-f6f44915e985 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:17.192756 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5ff3d4e4-afdc-464f-8bca-193cde53f28e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.078996 Dec 27 14:30:17.193411 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 593/1155] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:17 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:30:17.219600 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a059a0d9-2c10-47f6-a12e-f6f44915e985 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.101918 Dec 27 14:30:17.220276 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 563/1156] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:17 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:30:18.206559 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-47ba44fd-2c31-4483-9bd6-371b124c6019 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:18.207644 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-47ba44fd-2c31-4483-9bd6-371b124c6019 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:18.216492 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-47ba44fd-2c31-4483-9bd6-371b124c6019 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:18.216968 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-47ba44fd-2c31-4483-9bd6-371b124c6019 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:18.218392 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-47ba44fd-2c31-4483-9bd6-371b124c6019 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:18.218827 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-47ba44fd-2c31-4483-9bd6-371b124c6019 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:18.232324 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6a644a53-ffc7-4e46-bb62-99495364a95c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:18.234127 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6a644a53-ffc7-4e46-bb62-99495364a95c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:18.241046 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6a644a53-ffc7-4e46-bb62-99495364a95c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:18.241498 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6a644a53-ffc7-4e46-bb62-99495364a95c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:18.242281 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6a644a53-ffc7-4e46-bb62-99495364a95c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:18.242713 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6a644a53-ffc7-4e46-bb62-99495364a95c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:18.293236 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-47ba44fd-2c31-4483-9bd6-371b124c6019 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.092242 Dec 27 14:30:18.293895 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 594/1157] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:18 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:30:18.312192 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6a644a53-ffc7-4e46-bb62-99495364a95c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.083524 Dec 27 14:30:18.312940 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 564/1158] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:18 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:30:19.305542 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-365de1e8-5d36-4355-b81b-4e8136ba2f3c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:19.306546 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-365de1e8-5d36-4355-b81b-4e8136ba2f3c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:19.314117 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-365de1e8-5d36-4355-b81b-4e8136ba2f3c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:19.314566 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-365de1e8-5d36-4355-b81b-4e8136ba2f3c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:19.315351 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-365de1e8-5d36-4355-b81b-4e8136ba2f3c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:19.315790 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-365de1e8-5d36-4355-b81b-4e8136ba2f3c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:19.324375 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c4670336-7d0b-4f89-92dc-bc5e96075adc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:19.325371 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c4670336-7d0b-4f89-92dc-bc5e96075adc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:19.332302 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4670336-7d0b-4f89-92dc-bc5e96075adc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:19.332747 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4670336-7d0b-4f89-92dc-bc5e96075adc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:19.333525 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4670336-7d0b-4f89-92dc-bc5e96075adc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:19.333957 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4670336-7d0b-4f89-92dc-bc5e96075adc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:19.377672 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-365de1e8-5d36-4355-b81b-4e8136ba2f3c tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.076180 Dec 27 14:30:19.378547 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 595/1159] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:19 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:30:19.393322 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c4670336-7d0b-4f89-92dc-bc5e96075adc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.072955 Dec 27 14:30:19.394901 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 565/1160] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:19 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:30:20.389685 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6081f076-59c1-4b73-8a81-9d801073b416 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:20.390822 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6081f076-59c1-4b73-8a81-9d801073b416 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:20.397726 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6081f076-59c1-4b73-8a81-9d801073b416 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:20.398143 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6081f076-59c1-4b73-8a81-9d801073b416 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:20.398916 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6081f076-59c1-4b73-8a81-9d801073b416 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:20.399351 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6081f076-59c1-4b73-8a81-9d801073b416 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:20.406388 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2c283e33-7c2e-4c42-9e65-239aa7434b93 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:20.407397 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2c283e33-7c2e-4c42-9e65-239aa7434b93 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:20.414218 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c283e33-7c2e-4c42-9e65-239aa7434b93 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:20.414673 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c283e33-7c2e-4c42-9e65-239aa7434b93 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:20.415460 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c283e33-7c2e-4c42-9e65-239aa7434b93 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:20.415937 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c283e33-7c2e-4c42-9e65-239aa7434b93 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:20.465903 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6081f076-59c1-4b73-8a81-9d801073b416 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.080068 Dec 27 14:30:20.466547 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 596/1161] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:20 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:30:20.478559 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2c283e33-7c2e-4c42-9e65-239aa7434b93 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.076818 Dec 27 14:30:20.479193 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 566/1162] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:20 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:30:21.478733 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0391807f-b9cb-4880-afce-1ae35344a8a2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:21.479740 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0391807f-b9cb-4880-afce-1ae35344a8a2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:21.490646 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bec4c694-fc22-4192-b983-a34ad07ae92f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:21.491163 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0391807f-b9cb-4880-afce-1ae35344a8a2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:21.491271 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0391807f-b9cb-4880-afce-1ae35344a8a2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:21.491639 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bec4c694-fc22-4192-b983-a34ad07ae92f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:21.492015 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0391807f-b9cb-4880-afce-1ae35344a8a2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:21.492455 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0391807f-b9cb-4880-afce-1ae35344a8a2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:21.498459 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bec4c694-fc22-4192-b983-a34ad07ae92f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:21.498907 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bec4c694-fc22-4192-b983-a34ad07ae92f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:21.499727 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bec4c694-fc22-4192-b983-a34ad07ae92f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:21.500180 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bec4c694-fc22-4192-b983-a34ad07ae92f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:21.557283 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0391807f-b9cb-4880-afce-1ae35344a8a2 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.082408 Dec 27 14:30:21.558015 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 597/1163] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:21 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:30:21.562731 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bec4c694-fc22-4192-b983-a34ad07ae92f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.075838 Dec 27 14:30:21.563367 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 567/1164] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:21 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:30:22.568998 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-406e6024-a88b-4992-852c-c2c149f828a6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:22.569875 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-406e6024-a88b-4992-852c-c2c149f828a6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:22.575251 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-79963d05-5030-4865-9824-ae747f2166db tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:22.576395 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-79963d05-5030-4865-9824-ae747f2166db tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:22.577063 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-406e6024-a88b-4992-852c-c2c149f828a6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:22.577608 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-406e6024-a88b-4992-852c-c2c149f828a6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:22.578584 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-406e6024-a88b-4992-852c-c2c149f828a6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:22.579017 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-406e6024-a88b-4992-852c-c2c149f828a6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:22.583442 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-79963d05-5030-4865-9824-ae747f2166db tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:22.583963 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-79963d05-5030-4865-9824-ae747f2166db tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:22.584765 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-79963d05-5030-4865-9824-ae747f2166db tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:22.585206 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-79963d05-5030-4865-9824-ae747f2166db tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:22.646621 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-406e6024-a88b-4992-852c-c2c149f828a6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.081640 Dec 27 14:30:22.648194 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 598/1165] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:22 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:30:22.649768 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-79963d05-5030-4865-9824-ae747f2166db tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.078728 Dec 27 14:30:22.650395 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 568/1166] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:22 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:23.659212 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-61e42524-6c6b-4d30-8903-313a77bddeee tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:23.660173 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-61e42524-6c6b-4d30-8903-313a77bddeee tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:23.661953 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fca7bba0-4998-4118-b4fe-465a4c741652 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:23.663037 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fca7bba0-4998-4118-b4fe-465a4c741652 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:23.667129 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-61e42524-6c6b-4d30-8903-313a77bddeee tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:23.667586 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-61e42524-6c6b-4d30-8903-313a77bddeee tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:23.668405 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-61e42524-6c6b-4d30-8903-313a77bddeee tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:23.668855 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-61e42524-6c6b-4d30-8903-313a77bddeee tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:23.669937 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fca7bba0-4998-4118-b4fe-465a4c741652 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:23.670387 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fca7bba0-4998-4118-b4fe-465a4c741652 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:23.671173 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fca7bba0-4998-4118-b4fe-465a4c741652 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:23.672145 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fca7bba0-4998-4118-b4fe-465a4c741652 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:23.729363 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-61e42524-6c6b-4d30-8903-313a77bddeee tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28626 microversion: 2.1 time: 0.074341 Dec 27 14:30:23.730014 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 599/1167] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:23 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28626 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:30:23.738433 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fca7bba0-4998-4118-b4fe-465a4c741652 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.080522 Dec 27 14:30:23.739087 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 569/1168] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:23 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:30:24.741620 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5a72e7bc-12f4-459a-83a9-5f45e1e87582 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:24.742626 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5a72e7bc-12f4-459a-83a9-5f45e1e87582 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:24.750249 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5a72e7bc-12f4-459a-83a9-5f45e1e87582 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:24.750507 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a573fbf0-4334-4aa1-bd3f-09f08b5d851d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:24.751285 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a573fbf0-4334-4aa1-bd3f-09f08b5d851d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:24.751513 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5a72e7bc-12f4-459a-83a9-5f45e1e87582 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:24.752368 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5a72e7bc-12f4-459a-83a9-5f45e1e87582 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:24.752807 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5a72e7bc-12f4-459a-83a9-5f45e1e87582 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:24.758171 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a573fbf0-4334-4aa1-bd3f-09f08b5d851d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:24.758625 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a573fbf0-4334-4aa1-bd3f-09f08b5d851d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:24.759411 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a573fbf0-4334-4aa1-bd3f-09f08b5d851d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:24.759860 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a573fbf0-4334-4aa1-bd3f-09f08b5d851d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:24.848127 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5a72e7bc-12f4-459a-83a9-5f45e1e87582 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 28745 microversion: 2.1 time: 0.110434 Dec 27 14:30:24.848812 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 600/1169] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:24 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 28745 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:30:24.854433 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a573fbf0-4334-4aa1-bd3f-09f08b5d851d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.108535 Dec 27 14:30:24.855063 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 570/1170] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:24 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:30:25.859969 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6af8e6fe-c7a4-406a-83ad-e738586c5c94 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:25.860989 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6af8e6fe-c7a4-406a-83ad-e738586c5c94 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:25.866287 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8ee18224-ea02-4732-a687-e7a8994839eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:25.867386 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8ee18224-ea02-4732-a687-e7a8994839eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:25.868038 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6af8e6fe-c7a4-406a-83ad-e738586c5c94 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:25.868499 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6af8e6fe-c7a4-406a-83ad-e738586c5c94 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:25.869301 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6af8e6fe-c7a4-406a-83ad-e738586c5c94 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:25.869741 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6af8e6fe-c7a4-406a-83ad-e738586c5c94 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:25.874339 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ee18224-ea02-4732-a687-e7a8994839eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:25.874783 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ee18224-ea02-4732-a687-e7a8994839eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:25.875567 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ee18224-ea02-4732-a687-e7a8994839eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:25.876044 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8ee18224-ea02-4732-a687-e7a8994839eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:25.947336 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6af8e6fe-c7a4-406a-83ad-e738586c5c94 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 30796 microversion: 2.1 time: 0.091476 Dec 27 14:30:25.948004 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 601/1171] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:25 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 30796 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:30:25.955924 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8ee18224-ea02-4732-a687-e7a8994839eb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.093348 Dec 27 14:30:25.956547 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 571/1172] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:25 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:30:26.959157 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5858bcf5-718f-4546-9b6b-88414e415ff5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:26.960210 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5858bcf5-718f-4546-9b6b-88414e415ff5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:26.967693 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-41e5ccc2-9edd-4b0d-b3ac-b55650796a43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:26.969441 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5858bcf5-718f-4546-9b6b-88414e415ff5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:26.969573 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-41e5ccc2-9edd-4b0d-b3ac-b55650796a43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:26.970038 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5858bcf5-718f-4546-9b6b-88414e415ff5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:26.970820 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5858bcf5-718f-4546-9b6b-88414e415ff5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:26.971252 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5858bcf5-718f-4546-9b6b-88414e415ff5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:26.976467 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41e5ccc2-9edd-4b0d-b3ac-b55650796a43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:26.976923 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41e5ccc2-9edd-4b0d-b3ac-b55650796a43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:26.977721 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41e5ccc2-9edd-4b0d-b3ac-b55650796a43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:26.978164 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41e5ccc2-9edd-4b0d-b3ac-b55650796a43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:27.047723 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5858bcf5-718f-4546-9b6b-88414e415ff5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 32696 microversion: 2.1 time: 0.091846 Dec 27 14:30:27.048430 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 602/1173] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:26 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 32696 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:30:27.060561 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-41e5ccc2-9edd-4b0d-b3ac-b55650796a43 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.096731 Dec 27 14:30:27.061242 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 572/1174] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:26 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:30:28.059379 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ac8fd8da-b522-4916-976c-f203a31db31f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:28.060339 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ac8fd8da-b522-4916-976c-f203a31db31f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:28.067938 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac8fd8da-b522-4916-976c-f203a31db31f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:28.068388 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac8fd8da-b522-4916-976c-f203a31db31f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:28.069176 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac8fd8da-b522-4916-976c-f203a31db31f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:28.069614 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ac8fd8da-b522-4916-976c-f203a31db31f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:28.072329 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0d310c54-94a1-4f79-bd28-177d74f036b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:28.073332 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0d310c54-94a1-4f79-bd28-177d74f036b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:28.080299 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d310c54-94a1-4f79-bd28-177d74f036b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:28.080759 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d310c54-94a1-4f79-bd28-177d74f036b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:28.081552 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d310c54-94a1-4f79-bd28-177d74f036b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:28.081987 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0d310c54-94a1-4f79-bd28-177d74f036b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:28.145983 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ac8fd8da-b522-4916-976c-f203a31db31f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 33635 microversion: 2.1 time: 0.090835 Dec 27 14:30:28.146724 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 603/1175] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:28 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 33635 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:30:28.151104 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0d310c54-94a1-4f79-bd28-177d74f036b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.082636 Dec 27 14:30:28.151753 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 573/1176] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:28 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:30:29.158897 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-24ffbd22-ea92-4540-9ea3-aa8dfb97e072 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:29.159934 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-24ffbd22-ea92-4540-9ea3-aa8dfb97e072 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:29.163040 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8dd55be5-3113-4e7c-a129-f30b1974e3f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:29.164067 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8dd55be5-3113-4e7c-a129-f30b1974e3f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:29.166850 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24ffbd22-ea92-4540-9ea3-aa8dfb97e072 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:29.167302 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24ffbd22-ea92-4540-9ea3-aa8dfb97e072 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:29.168117 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24ffbd22-ea92-4540-9ea3-aa8dfb97e072 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:29.168558 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-24ffbd22-ea92-4540-9ea3-aa8dfb97e072 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:29.170538 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8dd55be5-3113-4e7c-a129-f30b1974e3f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:29.170975 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8dd55be5-3113-4e7c-a129-f30b1974e3f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:29.171749 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8dd55be5-3113-4e7c-a129-f30b1974e3f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:29.172264 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8dd55be5-3113-4e7c-a129-f30b1974e3f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:29.241127 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8dd55be5-3113-4e7c-a129-f30b1974e3f9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.081825 Dec 27 14:30:29.242014 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 574/1177] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:29 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:30:29.254907 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-24ffbd22-ea92-4540-9ea3-aa8dfb97e072 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 34859 microversion: 2.1 time: 0.100068 Dec 27 14:30:29.255593 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 604/1178] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:29 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 34859 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:30:30.253346 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-de3648e0-52d0-49b3-8fd0-7d4c8e3c8133 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:30.254351 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-de3648e0-52d0-49b3-8fd0-7d4c8e3c8133 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:30.261282 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-de3648e0-52d0-49b3-8fd0-7d4c8e3c8133 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:30.261719 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-de3648e0-52d0-49b3-8fd0-7d4c8e3c8133 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:30.262502 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-de3648e0-52d0-49b3-8fd0-7d4c8e3c8133 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:30.262933 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-de3648e0-52d0-49b3-8fd0-7d4c8e3c8133 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:30.267529 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6837edbd-5965-4d3d-95fd-830ead8b734f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:30.268573 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6837edbd-5965-4d3d-95fd-830ead8b734f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:30.275244 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6837edbd-5965-4d3d-95fd-830ead8b734f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:30.275693 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6837edbd-5965-4d3d-95fd-830ead8b734f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:30.276529 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6837edbd-5965-4d3d-95fd-830ead8b734f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:30.276965 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6837edbd-5965-4d3d-95fd-830ead8b734f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:30.330688 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-de3648e0-52d0-49b3-8fd0-7d4c8e3c8133 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.081399 Dec 27 14:30:30.331362 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 575/1179] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:30 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:30.356943 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6837edbd-5965-4d3d-95fd-830ead8b734f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 36056 microversion: 2.1 time: 0.093974 Dec 27 14:30:30.358227 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 605/1180] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:30 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 36056 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:30:31.342849 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-880f9e81-c7c0-40b2-8279-ce63e7379bb5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:31.344192 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-880f9e81-c7c0-40b2-8279-ce63e7379bb5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:31.351043 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-880f9e81-c7c0-40b2-8279-ce63e7379bb5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:31.351498 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-880f9e81-c7c0-40b2-8279-ce63e7379bb5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:31.352347 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-880f9e81-c7c0-40b2-8279-ce63e7379bb5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:31.352784 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-880f9e81-c7c0-40b2-8279-ce63e7379bb5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:31.369300 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-25f8dfdb-3f6e-4538-8376-a89ba1a48383 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:31.370297 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-25f8dfdb-3f6e-4538-8376-a89ba1a48383 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:31.378933 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-25f8dfdb-3f6e-4538-8376-a89ba1a48383 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:31.378933 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-25f8dfdb-3f6e-4538-8376-a89ba1a48383 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:31.379530 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-25f8dfdb-3f6e-4538-8376-a89ba1a48383 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:31.380001 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-25f8dfdb-3f6e-4538-8376-a89ba1a48383 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:31.427738 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-880f9e81-c7c0-40b2-8279-ce63e7379bb5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 28657 microversion: 2.20 time: 0.088715 Dec 27 14:30:31.428352 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 576/1181] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:31 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 28657 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:31.452398 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-25f8dfdb-3f6e-4538-8376-a89ba1a48383 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 37734 microversion: 2.1 time: 0.086919 Dec 27 14:30:31.453111 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 606/1182] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:31 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 37734 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:30:32.440253 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-99cd8f23-2a94-49e6-b3ff-a494f8a2b2b8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:32.441402 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-99cd8f23-2a94-49e6-b3ff-a494f8a2b2b8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:32.448369 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99cd8f23-2a94-49e6-b3ff-a494f8a2b2b8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:32.448816 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99cd8f23-2a94-49e6-b3ff-a494f8a2b2b8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:32.449599 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99cd8f23-2a94-49e6-b3ff-a494f8a2b2b8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:32.450026 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-99cd8f23-2a94-49e6-b3ff-a494f8a2b2b8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:32.464794 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8e4de1d7-615b-49f1-a977-47b152bba483 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:32.465803 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8e4de1d7-615b-49f1-a977-47b152bba483 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:32.473020 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8e4de1d7-615b-49f1-a977-47b152bba483 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:32.473481 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8e4de1d7-615b-49f1-a977-47b152bba483 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:32.474274 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8e4de1d7-615b-49f1-a977-47b152bba483 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:32.474716 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8e4de1d7-615b-49f1-a977-47b152bba483 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:32.531255 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-99cd8f23-2a94-49e6-b3ff-a494f8a2b2b8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 29041 microversion: 2.20 time: 0.095376 Dec 27 14:30:32.531919 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 577/1183] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:32 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 29041 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:32.554674 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8e4de1d7-615b-49f1-a977-47b152bba483 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 38160 microversion: 2.1 time: 0.093724 Dec 27 14:30:32.557486 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 607/1184] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:32 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 38160 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:30:33.543068 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-32927a5a-37a7-4279-94bb-1992397bb001 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:33.544115 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-32927a5a-37a7-4279-94bb-1992397bb001 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:33.551101 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32927a5a-37a7-4279-94bb-1992397bb001 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:33.551556 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32927a5a-37a7-4279-94bb-1992397bb001 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:33.552375 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32927a5a-37a7-4279-94bb-1992397bb001 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:33.552812 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32927a5a-37a7-4279-94bb-1992397bb001 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:33.567059 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fdcb3a18-f475-486c-9d5f-f3459a32c84e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:33.568094 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fdcb3a18-f475-486c-9d5f-f3459a32c84e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:33.575038 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fdcb3a18-f475-486c-9d5f-f3459a32c84e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:33.575496 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fdcb3a18-f475-486c-9d5f-f3459a32c84e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:33.576318 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fdcb3a18-f475-486c-9d5f-f3459a32c84e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:33.576758 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fdcb3a18-f475-486c-9d5f-f3459a32c84e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:33.633093 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-32927a5a-37a7-4279-94bb-1992397bb001 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 31238 microversion: 2.20 time: 0.093923 Dec 27 14:30:33.633748 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 578/1185] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:33 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 31238 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:33.651386 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fdcb3a18-f475-486c-9d5f-f3459a32c84e tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 38160 microversion: 2.1 time: 0.088278 Dec 27 14:30:33.652059 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 608/1186] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:33 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 38160 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:30:34.646179 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4c278e6f-b5ab-44a9-aa57-d66a8f469fc9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:34.647115 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4c278e6f-b5ab-44a9-aa57-d66a8f469fc9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:34.655463 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4c278e6f-b5ab-44a9-aa57-d66a8f469fc9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:34.657094 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4c278e6f-b5ab-44a9-aa57-d66a8f469fc9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:34.657094 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4c278e6f-b5ab-44a9-aa57-d66a8f469fc9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:34.657480 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4c278e6f-b5ab-44a9-aa57-d66a8f469fc9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:34.663249 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b7859a6b-69e6-4f2b-943d-8ea2e1c1d813 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:34.664392 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b7859a6b-69e6-4f2b-943d-8ea2e1c1d813 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:34.672362 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b7859a6b-69e6-4f2b-943d-8ea2e1c1d813 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:34.673232 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b7859a6b-69e6-4f2b-943d-8ea2e1c1d813 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:34.674434 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b7859a6b-69e6-4f2b-943d-8ea2e1c1d813 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:34.674881 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b7859a6b-69e6-4f2b-943d-8ea2e1c1d813 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:34.741960 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4c278e6f-b5ab-44a9-aa57-d66a8f469fc9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 32963 microversion: 2.20 time: 0.099717 Dec 27 14:30:34.742609 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 579/1187] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:34 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 32963 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:34.762247 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b7859a6b-69e6-4f2b-943d-8ea2e1c1d813 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 38160 microversion: 2.1 time: 0.102767 Dec 27 14:30:34.763365 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 609/1188] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:34 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 38160 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:30:35.755123 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d73de5a8-6cb6-42ad-bfbd-04f4af88e88a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:35.756152 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d73de5a8-6cb6-42ad-bfbd-04f4af88e88a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:35.763100 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d73de5a8-6cb6-42ad-bfbd-04f4af88e88a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:35.763550 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d73de5a8-6cb6-42ad-bfbd-04f4af88e88a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:35.764396 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d73de5a8-6cb6-42ad-bfbd-04f4af88e88a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:35.764829 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d73de5a8-6cb6-42ad-bfbd-04f4af88e88a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:35.775109 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-49e05f46-2b4b-4bee-a27c-0b886b58195d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:35.776179 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-49e05f46-2b4b-4bee-a27c-0b886b58195d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:35.785407 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-49e05f46-2b4b-4bee-a27c-0b886b58195d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:35.785871 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-49e05f46-2b4b-4bee-a27c-0b886b58195d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:35.786673 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-49e05f46-2b4b-4bee-a27c-0b886b58195d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:35.787110 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-49e05f46-2b4b-4bee-a27c-0b886b58195d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:35.846128 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d73de5a8-6cb6-42ad-bfbd-04f4af88e88a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 33850 microversion: 2.20 time: 0.094871 Dec 27 14:30:35.846792 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 580/1189] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:35 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 33850 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:30:35.858050 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-49e05f46-2b4b-4bee-a27c-0b886b58195d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 38160 microversion: 2.1 time: 0.086977 Dec 27 14:30:35.858962 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 610/1190] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:35 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 38160 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:30:36.858808 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5eb14d55-73ed-4705-a4a5-db908b159038 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:36.859805 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5eb14d55-73ed-4705-a4a5-db908b159038 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:36.867458 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5eb14d55-73ed-4705-a4a5-db908b159038 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:36.868059 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5eb14d55-73ed-4705-a4a5-db908b159038 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:36.868868 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5eb14d55-73ed-4705-a4a5-db908b159038 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:36.869348 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5eb14d55-73ed-4705-a4a5-db908b159038 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:36.871591 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-91c80f78-afcf-4b5e-a483-8279daf7465f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:36.873123 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-91c80f78-afcf-4b5e-a483-8279daf7465f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:36.880963 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-91c80f78-afcf-4b5e-a483-8279daf7465f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:36.881412 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-91c80f78-afcf-4b5e-a483-8279daf7465f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:36.882202 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-91c80f78-afcf-4b5e-a483-8279daf7465f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:36.882639 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-91c80f78-afcf-4b5e-a483-8279daf7465f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:36.957266 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5eb14d55-73ed-4705-a4a5-db908b159038 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 35110 microversion: 2.20 time: 0.102401 Dec 27 14:30:36.957916 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 581/1191] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:36 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 35110 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:36.981021 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-91c80f78-afcf-4b5e-a483-8279daf7465f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action" status: 200 len: 38291 microversion: 2.1 time: 0.113141 Dec 27 14:30:36.981906 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 611/1192] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:30:36 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/action => generated 38291 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 27 14:30:36.992665 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-34c9f30b-cafe-4c07-8ec3-1fad05db3aaa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:36.993240 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-34c9f30b-cafe-4c07-8ec3-1fad05db3aaa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:37.000317 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34c9f30b-cafe-4c07-8ec3-1fad05db3aaa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:37.000763 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34c9f30b-cafe-4c07-8ec3-1fad05db3aaa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:37.002227 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34c9f30b-cafe-4c07-8ec3-1fad05db3aaa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:37.002663 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-34c9f30b-cafe-4c07-8ec3-1fad05db3aaa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:37.031879 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-34c9f30b-cafe-4c07-8ec3-1fad05db3aaa tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/ips" status: 200 len: 146 microversion: 2.1 time: 0.039834 Dec 27 14:30:37.031879 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 582/1193] 10.222.0.37 () {58 vars in 1247 bytes} [Mon Dec 27 14:30:36 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:30:37.970034 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f6cbb01f-4213-428b-aeae-37e78a5de6b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:37.971052 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f6cbb01f-4213-428b-aeae-37e78a5de6b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:37.981972 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f6cbb01f-4213-428b-aeae-37e78a5de6b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:37.982434 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f6cbb01f-4213-428b-aeae-37e78a5de6b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:37.983230 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f6cbb01f-4213-428b-aeae-37e78a5de6b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:37.983682 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f6cbb01f-4213-428b-aeae-37e78a5de6b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:38.062177 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f6cbb01f-4213-428b-aeae-37e78a5de6b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 36331 microversion: 2.20 time: 0.096051 Dec 27 14:30:38.062800 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 612/1194] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:37 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 36331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:38.349415 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-476bb80e-d1ea-45b5-b3a8-3c05da8aab6f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15aa9721-3a80-4e9e-93bc-9b21415f19de"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:38.350457 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-476bb80e-d1ea-45b5-b3a8-3c05da8aab6f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:38.357016 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-476bb80e-d1ea-45b5-b3a8-3c05da8aab6f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:38.357462 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-476bb80e-d1ea-45b5-b3a8-3c05da8aab6f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:38.358244 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-476bb80e-d1ea-45b5-b3a8-3c05da8aab6f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:38.358670 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-476bb80e-d1ea-45b5-b3a8-3c05da8aab6f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:38.764828 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-476bb80e-d1ea-45b5-b3a8-3c05da8aab6f tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.419592 Dec 27 14:30:38.765564 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 583/1195] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Dec 27 14:30:38 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-volume_attachments => generated 194 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:30:39.075348 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0ed1e64f-b6e7-425a-a280-0d005067b1f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:39.076444 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0ed1e64f-b6e7-425a-a280-0d005067b1f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:39.084099 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0ed1e64f-b6e7-425a-a280-0d005067b1f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:39.084793 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0ed1e64f-b6e7-425a-a280-0d005067b1f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:39.085583 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0ed1e64f-b6e7-425a-a280-0d005067b1f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:39.086019 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0ed1e64f-b6e7-425a-a280-0d005067b1f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:39.174063 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0ed1e64f-b6e7-425a-a280-0d005067b1f2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 37872 microversion: 2.20 time: 0.102445 Dec 27 14:30:39.174738 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 613/1196] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:39 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 37872 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 27 14:30:40.186249 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ca0ce127-3f07-42cf-9c88-f083ad9f9380 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:40.187265 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ca0ce127-3f07-42cf-9c88-f083ad9f9380 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:40.193912 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca0ce127-3f07-42cf-9c88-f083ad9f9380 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:40.194367 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca0ce127-3f07-42cf-9c88-f083ad9f9380 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:40.195168 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca0ce127-3f07-42cf-9c88-f083ad9f9380 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:40.195609 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ca0ce127-3f07-42cf-9c88-f083ad9f9380 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:40.276932 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ca0ce127-3f07-42cf-9c88-f083ad9f9380 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 38211 microversion: 2.20 time: 0.095169 Dec 27 14:30:40.281428 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 584/1197] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:40 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 38211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:41.290216 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0675327c-d63f-4dc6-b958-1a64d5b2c478 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:41.291227 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0675327c-d63f-4dc6-b958-1a64d5b2c478 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:41.298929 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0675327c-d63f-4dc6-b958-1a64d5b2c478 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:41.299380 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0675327c-d63f-4dc6-b958-1a64d5b2c478 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:41.300192 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0675327c-d63f-4dc6-b958-1a64d5b2c478 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:41.300659 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0675327c-d63f-4dc6-b958-1a64d5b2c478 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:41.362042 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0675327c-d63f-4dc6-b958-1a64d5b2c478 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 38211 microversion: 2.20 time: 0.075838 Dec 27 14:30:41.362922 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 614/1198] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:41 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 38211 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:42.374979 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4212249e-5791-414e-8fd6-2c3c4fdd31f1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:42.376731 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4212249e-5791-414e-8fd6-2c3c4fdd31f1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:42.383683 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4212249e-5791-414e-8fd6-2c3c4fdd31f1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:42.384174 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4212249e-5791-414e-8fd6-2c3c4fdd31f1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:42.384962 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4212249e-5791-414e-8fd6-2c3c4fdd31f1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:42.385397 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4212249e-5791-414e-8fd6-2c3c4fdd31f1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:42.455382 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4212249e-5791-414e-8fd6-2c3c4fdd31f1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 38211 microversion: 2.20 time: 0.084336 Dec 27 14:30:42.456027 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 585/1199] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:42 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 38211 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:43.467206 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0d101c71-ca7d-495b-831d-d8f1251eeb30 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:43.468252 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0d101c71-ca7d-495b-831d-d8f1251eeb30 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:43.475136 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0d101c71-ca7d-495b-831d-d8f1251eeb30 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:43.475578 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0d101c71-ca7d-495b-831d-d8f1251eeb30 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:43.476373 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0d101c71-ca7d-495b-831d-d8f1251eeb30 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:43.476807 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0d101c71-ca7d-495b-831d-d8f1251eeb30 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:43.546922 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0d101c71-ca7d-495b-831d-d8f1251eeb30 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 38218 microversion: 2.20 time: 0.083647 Dec 27 14:30:43.547560 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 615/1200] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:43 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 38218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:44.558637 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d2c50a17-ee88-4e34-9a08-e275ff03af60 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:44.559647 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d2c50a17-ee88-4e34-9a08-e275ff03af60 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:44.566997 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2c50a17-ee88-4e34-9a08-e275ff03af60 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:44.567447 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2c50a17-ee88-4e34-9a08-e275ff03af60 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:44.568377 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2c50a17-ee88-4e34-9a08-e275ff03af60 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:44.568810 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d2c50a17-ee88-4e34-9a08-e275ff03af60 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:44.638967 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d2c50a17-ee88-4e34-9a08-e275ff03af60 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 200 len: 38352 microversion: 2.20 time: 0.084183 Dec 27 14:30:44.639596 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 586/1201] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:44 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 38352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:44.650261 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0b29419d-2ee2-4023-beb4-414c48519ecf tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:44.650839 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0b29419d-2ee2-4023-beb4-414c48519ecf tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:44.658602 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0b29419d-2ee2-4023-beb4-414c48519ecf tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:44.659044 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0b29419d-2ee2-4023-beb4-414c48519ecf tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:44.659819 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0b29419d-2ee2-4023-beb4-414c48519ecf tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:44.660275 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0b29419d-2ee2-4023-beb4-414c48519ecf tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:44.685132 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0b29419d-2ee2-4023-beb4-414c48519ecf tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/ips" status: 200 len: 153 microversion: 2.20 time: 0.038850 Dec 27 14:30:44.685695 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 616/1202] 10.222.0.37 () {60 vars in 1288 bytes} [Mon Dec 27 14:30:44 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/ips => generated 153 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:30:46.225738 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f907cc9f-c5d2-407e-84a6-42052a3e13e8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:46.226733 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f907cc9f-c5d2-407e-84a6-42052a3e13e8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:46.233569 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f907cc9f-c5d2-407e-84a6-42052a3e13e8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:46.234015 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f907cc9f-c5d2-407e-84a6-42052a3e13e8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:46.234789 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f907cc9f-c5d2-407e-84a6-42052a3e13e8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:46.235903 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f907cc9f-c5d2-407e-84a6-42052a3e13e8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:46.265441 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f907cc9f-c5d2-407e-84a6-42052a3e13e8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043792 Dec 27 14:30:46.265984 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 587/1203] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:30:46 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:30:46.275351 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-72f695f3-66f9-4544-95f3-0a519846b879 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:46.275863 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-72f695f3-66f9-4544-95f3-0a519846b879 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:46.282349 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72f695f3-66f9-4544-95f3-0a519846b879 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:46.282786 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72f695f3-66f9-4544-95f3-0a519846b879 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:46.283554 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72f695f3-66f9-4544-95f3-0a519846b879 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:46.284015 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-72f695f3-66f9-4544-95f3-0a519846b879 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:46.312303 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-72f695f3-66f9-4544-95f3-0a519846b879 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-volume_attachments/15aa9721-3a80-4e9e-93bc-9b21415f19de" status: 200 len: 194 microversion: 2.1 time: 0.040562 Dec 27 14:30:46.312876 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 617/1204] 10.222.0.37 () {58 vars in 1412 bytes} [Mon Dec 27 14:30:46 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-volume_attachments/15aa9721-3a80-4e9e-93bc-9b21415f19de => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:30:46.795947 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-09c6ef50-a049-4cda-a48c-f2034654db26 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:46.796485 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-09c6ef50-a049-4cda-a48c-f2034654db26 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:46.802813 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-09c6ef50-a049-4cda-a48c-f2034654db26 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:46.803258 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-09c6ef50-a049-4cda-a48c-f2034654db26 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:46.804072 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-09c6ef50-a049-4cda-a48c-f2034654db26 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:46.804508 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-09c6ef50-a049-4cda-a48c-f2034654db26 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:46.827738 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-09c6ef50-a049-4cda-a48c-f2034654db26 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lazy-loading 'flavor' on Instance uuid 5f23091f-27bc-4397-ad23-c7aeafafb970 {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:30:47.076573 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-09c6ef50-a049-4cda-a48c-f2034654db26 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 202 len: 0 microversion: 2.20 time: 0.284194 Dec 27 14:30:47.077190 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 588/1205] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:30:46 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 27 14:30:47.085898 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-bdb13e06-f3d0-4a87-a425-ec343ba7d6ac tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:47.086510 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-bdb13e06-f3d0-4a87-a425-ec343ba7d6ac tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:47.093125 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bdb13e06-f3d0-4a87-a425-ec343ba7d6ac tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:47.093785 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bdb13e06-f3d0-4a87-a425-ec343ba7d6ac tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:47.095258 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bdb13e06-f3d0-4a87-a425-ec343ba7d6ac tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:47.095895 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-bdb13e06-f3d0-4a87-a425-ec343ba7d6ac tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:47.231115 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-bdb13e06-f3d0-4a87-a425-ec343ba7d6ac tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:47.239045 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-bdb13e06-f3d0-4a87-a425-ec343ba7d6ac tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:47.240588 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-bdb13e06-f3d0-4a87-a425-ec343ba7d6ac tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:47.241734 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-bdb13e06-f3d0-4a87-a425-ec343ba7d6ac tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1724 microversion: 2.20 time: 0.159610 Dec 27 14:30:47.242301 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 618/1206] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:30:47 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:30:47.605815 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4570e76f-63f8-452f-aa3f-93cd4b17db5a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd7395d5-6b76-4f1c-82e3-ed7df62692df"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:47.606934 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4570e76f-63f8-452f-aa3f-93cd4b17db5a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:47.613928 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4570e76f-63f8-452f-aa3f-93cd4b17db5a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:47.614370 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4570e76f-63f8-452f-aa3f-93cd4b17db5a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:47.615146 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4570e76f-63f8-452f-aa3f-93cd4b17db5a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:47.615576 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4570e76f-63f8-452f-aa3f-93cd4b17db5a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:47.862164 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4570e76f-63f8-452f-aa3f-93cd4b17db5a tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261043 Dec 27 14:30:47.862833 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 589/1207] 10.222.0.37 () {60 vars in 1322 bytes} [Mon Dec 27 14:30:47 2021] POST /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:30:48.261432 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a5f6b6b5-bfe5-4b8e-8212-8897851ce67f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:48.261986 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a5f6b6b5-bfe5-4b8e-8212-8897851ce67f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:48.268916 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a5f6b6b5-bfe5-4b8e-8212-8897851ce67f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:48.269368 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a5f6b6b5-bfe5-4b8e-8212-8897851ce67f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:48.270136 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a5f6b6b5-bfe5-4b8e-8212-8897851ce67f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:48.270567 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a5f6b6b5-bfe5-4b8e-8212-8897851ce67f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:48.408479 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a5f6b6b5-bfe5-4b8e-8212-8897851ce67f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:48.416140 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a5f6b6b5-bfe5-4b8e-8212-8897851ce67f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:48.417633 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a5f6b6b5-bfe5-4b8e-8212-8897851ce67f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:48.418782 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a5f6b6b5-bfe5-4b8e-8212-8897851ce67f tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1724 microversion: 2.20 time: 0.161340 Dec 27 14:30:48.419344 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 619/1208] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:30:48 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:30:49.437535 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f51bebc9-6a42-4749-9bf7-c6109c5dee32 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:49.438843 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f51bebc9-6a42-4749-9bf7-c6109c5dee32 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:49.445284 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f51bebc9-6a42-4749-9bf7-c6109c5dee32 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:49.445729 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f51bebc9-6a42-4749-9bf7-c6109c5dee32 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:49.446500 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f51bebc9-6a42-4749-9bf7-c6109c5dee32 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:49.446932 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f51bebc9-6a42-4749-9bf7-c6109c5dee32 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:49.577837 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f51bebc9-6a42-4749-9bf7-c6109c5dee32 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:49.585580 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f51bebc9-6a42-4749-9bf7-c6109c5dee32 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:49.587056 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f51bebc9-6a42-4749-9bf7-c6109c5dee32 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:49.588227 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f51bebc9-6a42-4749-9bf7-c6109c5dee32 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1724 microversion: 2.20 time: 0.154701 Dec 27 14:30:49.588781 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 590/1209] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:30:49 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:30:50.606430 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e72a5b21-89a5-4b3f-b780-3526ed6d7662 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:50.607038 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e72a5b21-89a5-4b3f-b780-3526ed6d7662 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:50.614535 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e72a5b21-89a5-4b3f-b780-3526ed6d7662 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:50.614991 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e72a5b21-89a5-4b3f-b780-3526ed6d7662 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:50.615779 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e72a5b21-89a5-4b3f-b780-3526ed6d7662 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:50.616327 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e72a5b21-89a5-4b3f-b780-3526ed6d7662 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:50.743978 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e72a5b21-89a5-4b3f-b780-3526ed6d7662 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:50.752259 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e72a5b21-89a5-4b3f-b780-3526ed6d7662 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:50.753753 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e72a5b21-89a5-4b3f-b780-3526ed6d7662 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:50.754912 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e72a5b21-89a5-4b3f-b780-3526ed6d7662 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1724 microversion: 2.20 time: 0.152235 Dec 27 14:30:50.755475 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 620/1210] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:30:50 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:30:50.886681 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8e6608b8-5d9d-4f18-9910-cdd4a08ea818 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:50.887184 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8e6608b8-5d9d-4f18-9910-cdd4a08ea818 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:50.893624 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8e6608b8-5d9d-4f18-9910-cdd4a08ea818 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:50.894081 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8e6608b8-5d9d-4f18-9910-cdd4a08ea818 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:50.894867 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8e6608b8-5d9d-4f18-9910-cdd4a08ea818 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:50.895309 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8e6608b8-5d9d-4f18-9910-cdd4a08ea818 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:50.920041 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8e6608b8-5d9d-4f18-9910-cdd4a08ea818 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 27 14:30:50.997426 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8e6608b8-5d9d-4f18-9910-cdd4a08ea818 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "DELETE /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d" status: 204 len: 0 microversion: 2.1 time: 0.114181 Dec 27 14:30:50.998240 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 591/1211] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Dec 27 14:30:50 2021] DELETE /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 27 14:30:51.005837 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6c216d82-c4cf-4ae8-a0d7-e5b786aa39bf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:51.006448 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6c216d82-c4cf-4ae8-a0d7-e5b786aa39bf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:51.012313 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c216d82-c4cf-4ae8-a0d7-e5b786aa39bf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:51.012767 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c216d82-c4cf-4ae8-a0d7-e5b786aa39bf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:51.013548 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c216d82-c4cf-4ae8-a0d7-e5b786aa39bf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:51.013989 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6c216d82-c4cf-4ae8-a0d7-e5b786aa39bf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:51.152419 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6c216d82-c4cf-4ae8-a0d7-e5b786aa39bf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:51.159850 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6c216d82-c4cf-4ae8-a0d7-e5b786aa39bf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d" status: 200 len: 1575 microversion: 2.1 time: 0.157592 Dec 27 14:30:51.160421 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 621/1212] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:30:51 2021] GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:30:51.773219 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a5348d60-ec5a-4d00-afe9-1a0897095430 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:51.773918 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a5348d60-ec5a-4d00-afe9-1a0897095430 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:51.780519 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a5348d60-ec5a-4d00-afe9-1a0897095430 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:51.780965 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a5348d60-ec5a-4d00-afe9-1a0897095430 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:51.782280 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a5348d60-ec5a-4d00-afe9-1a0897095430 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:51.782942 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a5348d60-ec5a-4d00-afe9-1a0897095430 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:51.919440 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a5348d60-ec5a-4d00-afe9-1a0897095430 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:51.928122 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a5348d60-ec5a-4d00-afe9-1a0897095430 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:51.929618 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a5348d60-ec5a-4d00-afe9-1a0897095430 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:51.930756 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a5348d60-ec5a-4d00-afe9-1a0897095430 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1724 microversion: 2.20 time: 0.161651 Dec 27 14:30:51.931308 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 592/1213] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:30:51 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:30:52.177091 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b6c1a0d9-5eb3-404c-af33-29135bfc68af tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:52.177708 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b6c1a0d9-5eb3-404c-af33-29135bfc68af tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:52.184118 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b6c1a0d9-5eb3-404c-af33-29135bfc68af tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:52.184577 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b6c1a0d9-5eb3-404c-af33-29135bfc68af tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:52.185366 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b6c1a0d9-5eb3-404c-af33-29135bfc68af tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:52.185804 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b6c1a0d9-5eb3-404c-af33-29135bfc68af tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:52.318418 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b6c1a0d9-5eb3-404c-af33-29135bfc68af tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:52.325789 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b6c1a0d9-5eb3-404c-af33-29135bfc68af tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d" status: 200 len: 1575 microversion: 2.1 time: 0.152352 Dec 27 14:30:52.326353 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 622/1214] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:30:52 2021] GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:30:52.949243 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-19032a28-fcc2-4658-ab3f-626a92859e58 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:52.949912 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-19032a28-fcc2-4658-ab3f-626a92859e58 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:52.956971 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-19032a28-fcc2-4658-ab3f-626a92859e58 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:52.957418 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-19032a28-fcc2-4658-ab3f-626a92859e58 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:52.958240 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-19032a28-fcc2-4658-ab3f-626a92859e58 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:52.958674 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-19032a28-fcc2-4658-ab3f-626a92859e58 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:53.088808 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-19032a28-fcc2-4658-ab3f-626a92859e58 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:53.097522 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-19032a28-fcc2-4658-ab3f-626a92859e58 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:53.099050 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-19032a28-fcc2-4658-ab3f-626a92859e58 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:53.100238 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-19032a28-fcc2-4658-ab3f-626a92859e58 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1724 microversion: 2.20 time: 0.154777 Dec 27 14:30:53.100805 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 593/1215] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:30:52 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:30:53.343368 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7a0df42f-c28d-4478-b04e-103821b8d41c tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:53.345343 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7a0df42f-c28d-4478-b04e-103821b8d41c tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:53.351788 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7a0df42f-c28d-4478-b04e-103821b8d41c tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:53.352383 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7a0df42f-c28d-4478-b04e-103821b8d41c tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:53.353396 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7a0df42f-c28d-4478-b04e-103821b8d41c tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:53.353868 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7a0df42f-c28d-4478-b04e-103821b8d41c tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:53.428903 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-7a0df42f-c28d-4478-b04e-103821b8d41c tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:53.436185 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7a0df42f-c28d-4478-b04e-103821b8d41c tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d" status: 200 len: 1508 microversion: 2.1 time: 0.096408 Dec 27 14:30:53.436963 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 623/1216] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:30:53 2021] GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d => generated 1508 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:30:53.610851 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-452b1bab-9372-400d-985a-615599613971 req-cb6e8b43-733e-44da-b2c1-a74a1300d23b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d", "name": "network-vif-deleted", "tag": "5b8c6947-5cbc-4988-981c-34cec1bb4240"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:53.612787 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:30:53.612787 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:30:53.634688 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-452b1bab-9372-400d-985a-615599613971 req-cb6e8b43-733e-44da-b2c1-a74a1300d23b service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:53.635460 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-452b1bab-9372-400d-985a-615599613971 req-cb6e8b43-733e-44da-b2c1-a74a1300d23b service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:53.651028 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-452b1bab-9372-400d-985a-615599613971 req-cb6e8b43-733e-44da-b2c1-a74a1300d23b service nova] Creating event network-vif-deleted:5b8c6947-5cbc-4988-981c-34cec1bb4240 for instance 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d on hv-cinder-82301 Dec 27 14:30:53.658861 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-452b1bab-9372-400d-985a-615599613971 req-cb6e8b43-733e-44da-b2c1-a74a1300d23b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051374 Dec 27 14:30:53.660142 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 594/1217] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:30:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:30:54.118571 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7e36b3fa-51ce-43b5-8d6c-501ecbacb64d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:54.119092 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7e36b3fa-51ce-43b5-8d6c-501ecbacb64d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:54.125366 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7e36b3fa-51ce-43b5-8d6c-501ecbacb64d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:54.126412 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7e36b3fa-51ce-43b5-8d6c-501ecbacb64d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:54.127224 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7e36b3fa-51ce-43b5-8d6c-501ecbacb64d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:54.127650 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7e36b3fa-51ce-43b5-8d6c-501ecbacb64d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:54.274103 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-7e36b3fa-51ce-43b5-8d6c-501ecbacb64d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:54.283184 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-7e36b3fa-51ce-43b5-8d6c-501ecbacb64d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:54.284746 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-7e36b3fa-51ce-43b5-8d6c-501ecbacb64d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:54.285980 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7e36b3fa-51ce-43b5-8d6c-501ecbacb64d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1724 microversion: 2.20 time: 0.171285 Dec 27 14:30:54.286561 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 624/1218] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:30:54 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:30:54.454998 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6ed8529c-cee5-4dd2-b5eb-d98d3cdc3431 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:54.455722 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6ed8529c-cee5-4dd2-b5eb-d98d3cdc3431 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:54.462276 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6ed8529c-cee5-4dd2-b5eb-d98d3cdc3431 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:54.462735 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6ed8529c-cee5-4dd2-b5eb-d98d3cdc3431 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:54.463526 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6ed8529c-cee5-4dd2-b5eb-d98d3cdc3431 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:54.463988 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6ed8529c-cee5-4dd2-b5eb-d98d3cdc3431 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:54.477804 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-6ed8529c-cee5-4dd2-b5eb-d98d3cdc3431 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] HTTP exception thrown: Instance 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d could not be found. Dec 27 14:30:54.478389 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6ed8529c-cee5-4dd2-b5eb-d98d3cdc3431 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Returning 404 to user: Instance 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:30:54.479215 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6ed8529c-cee5-4dd2-b5eb-d98d3cdc3431 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d" status: 404 len: 111 microversion: 2.1 time: 0.029153 Dec 27 14:30:54.479764 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 595/1219] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:30:54 2021] GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:30:54.588130 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-160e1477-1a1f-4eb5-a294-56f273954985 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-280349654", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-200701949", "security_groups": [{"name": "tempest-secgroup-smoke-474312789"}], "block_device_mapping_v2": [{"uuid": "15251d35-1fca-425b-ad65-449916ad3caa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dfbd514e-e372-4721-aac1-a9c7fb2e81c2"}]}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:54.709421 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.network.neutron [None req-160e1477-1a1f-4eb5-a294-56f273954985 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] validate_networks() for [('dfbd514e-e372-4721-aac1-a9c7fb2e81c2', None, None, None, None, None)] {{(pid=116105) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 27 14:30:55.072218 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-160e1477-1a1f-4eb5-a294-56f273954985 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Flavor limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 27 14:30:55.072642 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-160e1477-1a1f-4eb5-a294-56f273954985 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Image limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 27 14:30:55.073111 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-160e1477-1a1f-4eb5-a294-56f273954985 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Flavor pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 27 14:30:55.073519 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-160e1477-1a1f-4eb5-a294-56f273954985 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Image pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 27 14:30:55.073959 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-160e1477-1a1f-4eb5-a294-56f273954985 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 27 14:30:55.083017 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-160e1477-1a1f-4eb5-a294-56f273954985 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:55.083459 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-160e1477-1a1f-4eb5-a294-56f273954985 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:55.084312 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-160e1477-1a1f-4eb5-a294-56f273954985 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:55.084746 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-160e1477-1a1f-4eb5-a294-56f273954985 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:55.101308 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-160e1477-1a1f-4eb5-a294-56f273954985 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Getting quotas for project 05268adb4a234195999f6992b93b3175. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:30:55.105336 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-160e1477-1a1f-4eb5-a294-56f273954985 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Getting quotas for user 529e9e9288714c6297be093f1a5e8163 and project 05268adb4a234195999f6992b93b3175. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:30:55.161624 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-160e1477-1a1f-4eb5-a294-56f273954985 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Going to run 1 instances... {{(pid=116105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 27 14:30:55.163762 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-160e1477-1a1f-4eb5-a294-56f273954985 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: a929808f-f43c-4753-b748-dd6d74500c13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='15251d35-1fca-425b-ad65-449916ad3caa',volume_size=None,volume_type=None)] {{(pid=116105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 27 14:30:55.290370 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-160e1477-1a1f-4eb5-a294-56f273954985 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.705862 Dec 27 14:30:55.296045 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 625/1220] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Dec 27 14:30:54 2021] POST /compute/v2.1/servers => generated 405 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 27 14:30:55.301225 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ed573cce-4bd3-4295-ab3c-84a4e9c4b02e tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:55.301932 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ed573cce-4bd3-4295-ab3c-84a4e9c4b02e tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: a929808f-f43c-4753-b748-dd6d74500c13] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:55.327497 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4e466cf1-915b-42fe-913f-0faeda9309c6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:55.327497 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4e466cf1-915b-42fe-913f-0faeda9309c6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:55.330830 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4e466cf1-915b-42fe-913f-0faeda9309c6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:55.331286 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4e466cf1-915b-42fe-913f-0faeda9309c6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:55.332107 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4e466cf1-915b-42fe-913f-0faeda9309c6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:55.332546 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4e466cf1-915b-42fe-913f-0faeda9309c6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:55.356848 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ed573cce-4bd3-4295-ab3c-84a4e9c4b02e tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:55.363944 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ed573cce-4bd3-4295-ab3c-84a4e9c4b02e tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13" status: 200 len: 1093 microversion: 2.1 time: 0.066697 Dec 27 14:30:55.364522 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 596/1221] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:30:55 2021] GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:30:55.368850 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-62d770a5-4a10-4248-a032-dd11e853499d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:55.370469 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-62d770a5-4a10-4248-a032-dd11e853499d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:55.377794 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62d770a5-4a10-4248-a032-dd11e853499d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:55.378240 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62d770a5-4a10-4248-a032-dd11e853499d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:55.379034 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62d770a5-4a10-4248-a032-dd11e853499d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:55.379465 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-62d770a5-4a10-4248-a032-dd11e853499d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:55.412237 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-62d770a5-4a10-4248-a032-dd11e853499d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046637 Dec 27 14:30:55.412813 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 597/1222] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:30:55 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:30:55.487273 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4e466cf1-915b-42fe-913f-0faeda9309c6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:55.497006 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4e466cf1-915b-42fe-913f-0faeda9309c6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:55.498796 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4e466cf1-915b-42fe-913f-0faeda9309c6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:55.499757 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4e466cf1-915b-42fe-913f-0faeda9309c6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1724 microversion: 2.20 time: 0.194058 Dec 27 14:30:55.500718 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 626/1223] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:30:55 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:30:55.575205 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0da1310f-6993-447b-907f-8ec98edcd5f1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:55.575758 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0da1310f-6993-447b-907f-8ec98edcd5f1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:55.583039 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0da1310f-6993-447b-907f-8ec98edcd5f1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:55.583483 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0da1310f-6993-447b-907f-8ec98edcd5f1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:55.584326 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0da1310f-6993-447b-907f-8ec98edcd5f1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:55.584754 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0da1310f-6993-447b-907f-8ec98edcd5f1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:55.614435 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0da1310f-6993-447b-907f-8ec98edcd5f1 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-volume_attachments/15aa9721-3a80-4e9e-93bc-9b21415f19de" status: 200 len: 194 microversion: 2.1 time: 0.043272 Dec 27 14:30:55.615026 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 598/1224] 10.222.0.37 () {58 vars in 1412 bytes} [Mon Dec 27 14:30:55 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-volume_attachments/15aa9721-3a80-4e9e-93bc-9b21415f19de => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:30:55.624439 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8be7b05c-f992-4384-96d9-5e41aad442c9 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:55.624994 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8be7b05c-f992-4384-96d9-5e41aad442c9 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:55.631918 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8be7b05c-f992-4384-96d9-5e41aad442c9 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:55.632366 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8be7b05c-f992-4384-96d9-5e41aad442c9 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:55.633151 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8be7b05c-f992-4384-96d9-5e41aad442c9 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:55.633583 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8be7b05c-f992-4384-96d9-5e41aad442c9 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:55.718921 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.objects.instance [None req-8be7b05c-f992-4384-96d9-5e41aad442c9 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lazy-loading 'services' on Instance uuid 4b2fac49-b603-495e-a648-b56ca6920804 {{(pid=116105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:30:55.789302 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8be7b05c-f992-4384-96d9-5e41aad442c9 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "DELETE /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-volume_attachments/15aa9721-3a80-4e9e-93bc-9b21415f19de" status: 202 len: 0 microversion: 2.1 time: 0.168447 Dec 27 14:30:55.789883 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 627/1225] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Dec 27 14:30:55 2021] DELETE /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-volume_attachments/15aa9721-3a80-4e9e-93bc-9b21415f19de => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:56.381443 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c0905535-2aad-4ef1-9af4-3a186e97ddc5 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:56.382271 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c0905535-2aad-4ef1-9af4-3a186e97ddc5 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: a929808f-f43c-4753-b748-dd6d74500c13] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:56.388220 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0905535-2aad-4ef1-9af4-3a186e97ddc5 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:56.388782 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0905535-2aad-4ef1-9af4-3a186e97ddc5 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:56.389660 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0905535-2aad-4ef1-9af4-3a186e97ddc5 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:56.390416 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c0905535-2aad-4ef1-9af4-3a186e97ddc5 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:56.451512 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c0905535-2aad-4ef1-9af4-3a186e97ddc5 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:56.459728 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c0905535-2aad-4ef1-9af4-3a186e97ddc5 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13" status: 200 len: 1209 microversion: 2.1 time: 0.082081 Dec 27 14:30:56.460331 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 599/1226] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:30:56 2021] GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13 => generated 1209 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:30:56.518838 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-757f72be-5376-4d80-a383-ec2d4c5f4e2d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:56.519682 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-757f72be-5376-4d80-a383-ec2d4c5f4e2d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:56.525905 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-757f72be-5376-4d80-a383-ec2d4c5f4e2d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:56.526417 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-757f72be-5376-4d80-a383-ec2d4c5f4e2d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:56.527292 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-757f72be-5376-4d80-a383-ec2d4c5f4e2d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:56.527726 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-757f72be-5376-4d80-a383-ec2d4c5f4e2d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:56.812151 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-757f72be-5376-4d80-a383-ec2d4c5f4e2d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:56.822478 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-757f72be-5376-4d80-a383-ec2d4c5f4e2d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:56.837635 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-757f72be-5376-4d80-a383-ec2d4c5f4e2d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:56.837635 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-757f72be-5376-4d80-a383-ec2d4c5f4e2d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1724 microversion: 2.20 time: 0.310904 Dec 27 14:30:56.838203 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 628/1227] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:30:56 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:30:56.920656 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bd0584e2-0f4e-4061-8d38-7217f37d77c7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:56.921270 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bd0584e2-0f4e-4061-8d38-7217f37d77c7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:56.928041 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd0584e2-0f4e-4061-8d38-7217f37d77c7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:56.928536 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd0584e2-0f4e-4061-8d38-7217f37d77c7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:56.929346 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd0584e2-0f4e-4061-8d38-7217f37d77c7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:56.929789 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bd0584e2-0f4e-4061-8d38-7217f37d77c7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:56.976323 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bd0584e2-0f4e-4061-8d38-7217f37d77c7 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-volume_attachments/fd7395d5-6b76-4f1c-82e3-ed7df62692df" status: 200 len: 194 microversion: 2.1 time: 0.059717 Dec 27 14:30:56.977015 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 600/1228] 10.222.0.37 () {58 vars in 1412 bytes} [Mon Dec 27 14:30:56 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-volume_attachments/fd7395d5-6b76-4f1c-82e3-ed7df62692df => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:30:56.990890 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-912229ef-51b2-4bef-8fc1-d0a26436327d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:56.991733 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-912229ef-51b2-4bef-8fc1-d0a26436327d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:56.999117 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-912229ef-51b2-4bef-8fc1-d0a26436327d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:57.000969 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-912229ef-51b2-4bef-8fc1-d0a26436327d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:57.001812 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-912229ef-51b2-4bef-8fc1-d0a26436327d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:57.002813 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-912229ef-51b2-4bef-8fc1-d0a26436327d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:57.106318 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.objects.instance [None req-912229ef-51b2-4bef-8fc1-d0a26436327d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lazy-loading 'services' on Instance uuid 4b2fac49-b603-495e-a648-b56ca6920804 {{(pid=116105) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:30:57.226901 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-912229ef-51b2-4bef-8fc1-d0a26436327d tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "DELETE /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-volume_attachments/fd7395d5-6b76-4f1c-82e3-ed7df62692df" status: 202 len: 0 microversion: 2.1 time: 0.243102 Dec 27 14:30:57.228198 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 629/1229] 10.222.0.37 () {58 vars in 1415 bytes} [Mon Dec 27 14:30:56 2021] DELETE /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-volume_attachments/fd7395d5-6b76-4f1c-82e3-ed7df62692df => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:30:57.476850 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2db4fb68-7bd6-4167-8e8f-494a58c334a3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:57.477513 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2db4fb68-7bd6-4167-8e8f-494a58c334a3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: a929808f-f43c-4753-b748-dd6d74500c13] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:57.483136 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2db4fb68-7bd6-4167-8e8f-494a58c334a3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:57.483580 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2db4fb68-7bd6-4167-8e8f-494a58c334a3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:57.484395 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2db4fb68-7bd6-4167-8e8f-494a58c334a3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:57.484848 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2db4fb68-7bd6-4167-8e8f-494a58c334a3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:57.621375 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2db4fb68-7bd6-4167-8e8f-494a58c334a3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:57.630536 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2db4fb68-7bd6-4167-8e8f-494a58c334a3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13" status: 200 len: 1264 microversion: 2.1 time: 0.157254 Dec 27 14:30:57.631477 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 601/1230] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:30:57 2021] GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:30:57.847014 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0d9217a1-50d0-4dea-8af1-4fdb4c1021ef tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:57.847818 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0d9217a1-50d0-4dea-8af1-4fdb4c1021ef tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:57.854519 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0d9217a1-50d0-4dea-8af1-4fdb4c1021ef tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:57.855081 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0d9217a1-50d0-4dea-8af1-4fdb4c1021ef tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:57.855922 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0d9217a1-50d0-4dea-8af1-4fdb4c1021ef tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:57.856418 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0d9217a1-50d0-4dea-8af1-4fdb4c1021ef tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:57.878430 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-83031ea7-3012-4406-a823-3121b92a96e4 req-c3902302-e619-4f5c-8c8f-bfc51c986b55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a929808f-f43c-4753-b748-dd6d74500c13", "tag": "d2f2dd8e-ec15-4733-83a0-a34345736d8d"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:30:57.883651 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:30:57.883651 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:30:57.899077 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-83031ea7-3012-4406-a823-3121b92a96e4 req-c3902302-e619-4f5c-8c8f-bfc51c986b55 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:57.899593 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-83031ea7-3012-4406-a823-3121b92a96e4 req-c3902302-e619-4f5c-8c8f-bfc51c986b55 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:57.913602 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-83031ea7-3012-4406-a823-3121b92a96e4 req-c3902302-e619-4f5c-8c8f-bfc51c986b55 service nova] Creating event network-changed:d2f2dd8e-ec15-4733-83a0-a34345736d8d for instance a929808f-f43c-4753-b748-dd6d74500c13 on hv-cinder-82301 Dec 27 14:30:57.918515 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-83031ea7-3012-4406-a823-3121b92a96e4 req-c3902302-e619-4f5c-8c8f-bfc51c986b55 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046976 Dec 27 14:30:57.919171 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 602/1231] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:30:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:30:58.124521 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0d9217a1-50d0-4dea-8af1-4fdb4c1021ef tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:58.133474 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0d9217a1-50d0-4dea-8af1-4fdb4c1021ef tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:58.134964 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0d9217a1-50d0-4dea-8af1-4fdb4c1021ef tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:58.136187 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0d9217a1-50d0-4dea-8af1-4fdb4c1021ef tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1724 microversion: 2.20 time: 0.294856 Dec 27 14:30:58.136745 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 630/1232] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:30:57 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:30:58.409599 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-95678fa6-b66f-4efe-a5f8-e39240a16f27 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:58.410603 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-95678fa6-b66f-4efe-a5f8-e39240a16f27 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:58.417358 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-95678fa6-b66f-4efe-a5f8-e39240a16f27 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:58.417812 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-95678fa6-b66f-4efe-a5f8-e39240a16f27 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:58.418608 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-95678fa6-b66f-4efe-a5f8-e39240a16f27 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:58.419043 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-95678fa6-b66f-4efe-a5f8-e39240a16f27 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:58.449211 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-95678fa6-b66f-4efe-a5f8-e39240a16f27 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044095 Dec 27 14:30:58.450001 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 603/1233] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:30:58 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 27 14:30:58.550115 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c71fbc36-0c56-4bfc-b76c-ae222f16bb25 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:58.551109 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c71fbc36-0c56-4bfc-b76c-ae222f16bb25 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:58.556948 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c71fbc36-0c56-4bfc-b76c-ae222f16bb25 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:58.557397 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c71fbc36-0c56-4bfc-b76c-ae222f16bb25 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:58.558178 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c71fbc36-0c56-4bfc-b76c-ae222f16bb25 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:58.558619 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c71fbc36-0c56-4bfc-b76c-ae222f16bb25 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:58.587879 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c71fbc36-0c56-4bfc-b76c-ae222f16bb25 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041582 Dec 27 14:30:58.588729 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 631/1234] 10.222.0.37 () {58 vars in 1301 bytes} [Mon Dec 27 14:30:58 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 27 14:30:58.643994 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-61a9fd27-d029-4808-a379-c04f78377af8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:58.644616 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-61a9fd27-d029-4808-a379-c04f78377af8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:58.647696 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-aa6204fa-b73e-439c-a8da-22e82bfdc254 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:58.648340 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-aa6204fa-b73e-439c-a8da-22e82bfdc254 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: a929808f-f43c-4753-b748-dd6d74500c13] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:58.650895 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61a9fd27-d029-4808-a379-c04f78377af8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:58.651452 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61a9fd27-d029-4808-a379-c04f78377af8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:58.652646 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61a9fd27-d029-4808-a379-c04f78377af8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:58.653514 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-61a9fd27-d029-4808-a379-c04f78377af8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:58.654414 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa6204fa-b73e-439c-a8da-22e82bfdc254 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:58.654860 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa6204fa-b73e-439c-a8da-22e82bfdc254 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:58.655635 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa6204fa-b73e-439c-a8da-22e82bfdc254 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:58.656269 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa6204fa-b73e-439c-a8da-22e82bfdc254 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:58.679615 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-61a9fd27-d029-4808-a379-c04f78377af8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 27 14:30:58.763666 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-61a9fd27-d029-4808-a379-c04f78377af8 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "DELETE /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804" status: 204 len: 0 microversion: 2.1 time: 0.123596 Dec 27 14:30:58.764439 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 604/1235] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Dec 27 14:30:58 2021] DELETE /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 27 14:30:58.773727 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5f4027f3-99b3-439b-95b0-0ce0f3dfe3d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:58.774570 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5f4027f3-99b3-439b-95b0-0ce0f3dfe3d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:58.781090 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f4027f3-99b3-439b-95b0-0ce0f3dfe3d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:58.781612 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f4027f3-99b3-439b-95b0-0ce0f3dfe3d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:58.782571 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f4027f3-99b3-439b-95b0-0ce0f3dfe3d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:58.783077 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5f4027f3-99b3-439b-95b0-0ce0f3dfe3d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:58.862552 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-aa6204fa-b73e-439c-a8da-22e82bfdc254 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:58.873303 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-aa6204fa-b73e-439c-a8da-22e82bfdc254 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13" status: 200 len: 1264 microversion: 2.1 time: 0.229103 Dec 27 14:30:58.874026 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 632/1236] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:30:58 2021] GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13 => generated 1264 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:30:58.916607 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5f4027f3-99b3-439b-95b0-0ce0f3dfe3d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:58.924159 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5f4027f3-99b3-439b-95b0-0ce0f3dfe3d6 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804" status: 200 len: 1675 microversion: 2.1 time: 0.154662 Dec 27 14:30:58.924731 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 605/1237] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:30:58 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:30:59.154265 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-851c424a-772f-464f-ac20-5dac04c71a9e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:59.154877 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-851c424a-772f-464f-ac20-5dac04c71a9e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:59.161614 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-851c424a-772f-464f-ac20-5dac04c71a9e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:59.162062 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-851c424a-772f-464f-ac20-5dac04c71a9e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:59.162837 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-851c424a-772f-464f-ac20-5dac04c71a9e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:59.163273 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-851c424a-772f-464f-ac20-5dac04c71a9e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:59.296508 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-851c424a-772f-464f-ac20-5dac04c71a9e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:59.305176 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-851c424a-772f-464f-ac20-5dac04c71a9e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:59.306674 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-851c424a-772f-464f-ac20-5dac04c71a9e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:30:59.307878 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-851c424a-772f-464f-ac20-5dac04c71a9e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1745 microversion: 2.20 time: 0.157551 Dec 27 14:30:59.308447 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 633/1238] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:30:59 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:30:59.890302 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6a245c20-cefc-4daa-9197-3334ac4359d7 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:59.891559 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6a245c20-cefc-4daa-9197-3334ac4359d7 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: a929808f-f43c-4753-b748-dd6d74500c13] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:59.897918 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6a245c20-cefc-4daa-9197-3334ac4359d7 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:59.898373 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6a245c20-cefc-4daa-9197-3334ac4359d7 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:59.899222 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6a245c20-cefc-4daa-9197-3334ac4359d7 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:59.899670 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6a245c20-cefc-4daa-9197-3334ac4359d7 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:59.942111 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-93fd80f8-0c0c-481c-805f-dc3391280de4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:30:59.943817 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-93fd80f8-0c0c-481c-805f-dc3391280de4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:30:59.951142 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-93fd80f8-0c0c-481c-805f-dc3391280de4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:59.951594 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-93fd80f8-0c0c-481c-805f-dc3391280de4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:30:59.952413 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-93fd80f8-0c0c-481c-805f-dc3391280de4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:30:59.953032 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-93fd80f8-0c0c-481c-805f-dc3391280de4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:00.044328 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-6a245c20-cefc-4daa-9197-3334ac4359d7 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:00.052362 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6a245c20-cefc-4daa-9197-3334ac4359d7 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13" status: 200 len: 1264 microversion: 2.1 time: 0.165700 Dec 27 14:31:00.053031 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 606/1239] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:30:59 2021] GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:31:00.088932 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-93fd80f8-0c0c-481c-805f-dc3391280de4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:00.096642 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-93fd80f8-0c0c-481c-805f-dc3391280de4 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804" status: 200 len: 1675 microversion: 2.1 time: 0.159272 Dec 27 14:31:00.097211 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 634/1240] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:30:59 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:31:00.333306 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-664dc139-95b8-4da0-a8f2-fecaa463c4d0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:00.333908 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-664dc139-95b8-4da0-a8f2-fecaa463c4d0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:00.339733 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-664dc139-95b8-4da0-a8f2-fecaa463c4d0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:00.340207 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-664dc139-95b8-4da0-a8f2-fecaa463c4d0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:00.340977 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-664dc139-95b8-4da0-a8f2-fecaa463c4d0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:00.341410 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-664dc139-95b8-4da0-a8f2-fecaa463c4d0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:00.467673 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-664dc139-95b8-4da0-a8f2-fecaa463c4d0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:00.475291 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-664dc139-95b8-4da0-a8f2-fecaa463c4d0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:00.476870 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-664dc139-95b8-4da0-a8f2-fecaa463c4d0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:00.478009 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-664dc139-95b8-4da0-a8f2-fecaa463c4d0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1745 microversion: 2.20 time: 0.148436 Dec 27 14:31:00.478564 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 607/1241] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:00 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1745 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:01.068819 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-398f3739-e74b-4e66-acb7-242182c499a9 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:01.069430 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-398f3739-e74b-4e66-acb7-242182c499a9 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: a929808f-f43c-4753-b748-dd6d74500c13] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:01.075741 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-398f3739-e74b-4e66-acb7-242182c499a9 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:01.076232 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-398f3739-e74b-4e66-acb7-242182c499a9 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:01.077020 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-398f3739-e74b-4e66-acb7-242182c499a9 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:01.077462 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-398f3739-e74b-4e66-acb7-242182c499a9 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:01.113536 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b8b69d04-1ac5-454f-a97b-6416cb814338 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:01.114200 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b8b69d04-1ac5-454f-a97b-6416cb814338 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:01.121871 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8b69d04-1ac5-454f-a97b-6416cb814338 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:01.122321 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8b69d04-1ac5-454f-a97b-6416cb814338 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:01.123110 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8b69d04-1ac5-454f-a97b-6416cb814338 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:01.123544 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8b69d04-1ac5-454f-a97b-6416cb814338 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:01.216806 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-398f3739-e74b-4e66-acb7-242182c499a9 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:01.225580 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-398f3739-e74b-4e66-acb7-242182c499a9 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13" status: 200 len: 1264 microversion: 2.1 time: 0.160392 Dec 27 14:31:01.226160 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 635/1242] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:31:01 2021] GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:31:01.256354 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b8b69d04-1ac5-454f-a97b-6416cb814338 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:01.263539 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b8b69d04-1ac5-454f-a97b-6416cb814338 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804" status: 200 len: 1675 microversion: 2.1 time: 0.153954 Dec 27 14:31:01.264118 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 608/1243] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:31:01 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:31:01.497025 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-57d9b5d6-bcba-43b2-baac-657f2c733fab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:01.497665 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-57d9b5d6-bcba-43b2-baac-657f2c733fab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:01.504294 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-57d9b5d6-bcba-43b2-baac-657f2c733fab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:01.504787 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-57d9b5d6-bcba-43b2-baac-657f2c733fab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:01.505584 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-57d9b5d6-bcba-43b2-baac-657f2c733fab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:01.506014 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-57d9b5d6-bcba-43b2-baac-657f2c733fab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:01.793523 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-b31a5fb8-3868-45f0-a76c-5363b5f5dc45 req-4096212b-cc46-445e-a93d-3e12610fa236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f23091f-27bc-4397-ad23-c7aeafafb970", "name": "network-vif-plugged", "status": "completed", "tag": "d5856f9b-e239-4613-88a7-d15a19d0765d"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:31:01.795249 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:31:01.795249 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:31:01.804864 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-b31a5fb8-3868-45f0-a76c-5363b5f5dc45 req-4096212b-cc46-445e-a93d-3e12610fa236 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:01.805354 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-b31a5fb8-3868-45f0-a76c-5363b5f5dc45 req-4096212b-cc46-445e-a93d-3e12610fa236 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:01.820352 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-b31a5fb8-3868-45f0-a76c-5363b5f5dc45 req-4096212b-cc46-445e-a93d-3e12610fa236 service nova] Creating event network-vif-plugged:d5856f9b-e239-4613-88a7-d15a19d0765d for instance 5f23091f-27bc-4397-ad23-c7aeafafb970 on hv-cinder-82301 Dec 27 14:31:01.826028 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-b31a5fb8-3868-45f0-a76c-5363b5f5dc45 req-4096212b-cc46-445e-a93d-3e12610fa236 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036023 Dec 27 14:31:01.826890 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 609/1244] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:31:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:31:01.897964 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-57d9b5d6-bcba-43b2-baac-657f2c733fab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:01.906089 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-57d9b5d6-bcba-43b2-baac-657f2c733fab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:01.908308 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-57d9b5d6-bcba-43b2-baac-657f2c733fab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:01.909485 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-57d9b5d6-bcba-43b2-baac-657f2c733fab tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1745 microversion: 2.20 time: 0.416328 Dec 27 14:31:01.910050 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 636/1245] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:01 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1745 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:02.241990 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-36ef73ae-92c1-47b8-924e-819e01f94965 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:02.242686 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-36ef73ae-92c1-47b8-924e-819e01f94965 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: a929808f-f43c-4753-b748-dd6d74500c13] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:02.249631 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-36ef73ae-92c1-47b8-924e-819e01f94965 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:02.251314 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-36ef73ae-92c1-47b8-924e-819e01f94965 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:02.252170 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-36ef73ae-92c1-47b8-924e-819e01f94965 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:02.252608 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-36ef73ae-92c1-47b8-924e-819e01f94965 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:02.281030 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c2c6b1a3-df33-4ca2-a68b-7007b34c0065 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:02.284812 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c2c6b1a3-df33-4ca2-a68b-7007b34c0065 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:02.291065 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c2c6b1a3-df33-4ca2-a68b-7007b34c0065 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:02.291633 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c2c6b1a3-df33-4ca2-a68b-7007b34c0065 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:02.292553 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c2c6b1a3-df33-4ca2-a68b-7007b34c0065 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:02.293218 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c2c6b1a3-df33-4ca2-a68b-7007b34c0065 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:02.368756 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c2c6b1a3-df33-4ca2-a68b-7007b34c0065 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c8987f7dafc41f999a222eb0145ae95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3987a0b7a4764509990d2849d59e6238', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:02.377840 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c2c6b1a3-df33-4ca2-a68b-7007b34c0065 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804" status: 200 len: 1607 microversion: 2.1 time: 0.100505 Dec 27 14:31:02.378714 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 637/1246] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:31:02 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804 => generated 1607 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:31:02.397723 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-36ef73ae-92c1-47b8-924e-819e01f94965 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:02.405419 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-36ef73ae-92c1-47b8-924e-819e01f94965 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13" status: 200 len: 1264 microversion: 2.1 time: 0.167428 Dec 27 14:31:02.406091 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 610/1247] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:31:02 2021] GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:31:02.479115 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-a147b8ef-e4d7-42af-8603-6cc169892c9f req-8c64ae65-ec93-4356-8d7e-9c1836fc60a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b2fac49-b603-495e-a648-b56ca6920804", "name": "network-vif-deleted", "tag": "8b910194-49c4-4494-b8a1-60502c78b5a1"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:31:02.481108 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:31:02.481108 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:31:02.503193 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-a147b8ef-e4d7-42af-8603-6cc169892c9f req-8c64ae65-ec93-4356-8d7e-9c1836fc60a2 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:02.503639 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-a147b8ef-e4d7-42af-8603-6cc169892c9f req-8c64ae65-ec93-4356-8d7e-9c1836fc60a2 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:02.520472 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-a147b8ef-e4d7-42af-8603-6cc169892c9f req-8c64ae65-ec93-4356-8d7e-9c1836fc60a2 service nova] Creating event network-vif-deleted:8b910194-49c4-4494-b8a1-60502c78b5a1 for instance 4b2fac49-b603-495e-a648-b56ca6920804 on hv-cinder-82301 Dec 27 14:31:02.526485 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-a147b8ef-e4d7-42af-8603-6cc169892c9f req-8c64ae65-ec93-4356-8d7e-9c1836fc60a2 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050515 Dec 27 14:31:02.527215 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 638/1248] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:31:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:31:02.929142 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8b76089b-89ba-4ca1-b02d-899d2b2d9808 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:02.929950 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8b76089b-89ba-4ca1-b02d-899d2b2d9808 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:02.936590 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b76089b-89ba-4ca1-b02d-899d2b2d9808 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:02.937477 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b76089b-89ba-4ca1-b02d-899d2b2d9808 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:02.939412 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b76089b-89ba-4ca1-b02d-899d2b2d9808 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:02.939893 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8b76089b-89ba-4ca1-b02d-899d2b2d9808 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:03.075952 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8b76089b-89ba-4ca1-b02d-899d2b2d9808 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:03.084303 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8b76089b-89ba-4ca1-b02d-899d2b2d9808 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:03.085804 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8b76089b-89ba-4ca1-b02d-899d2b2d9808 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:03.086958 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8b76089b-89ba-4ca1-b02d-899d2b2d9808 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1745 microversion: 2.20 time: 0.162401 Dec 27 14:31:03.087524 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 611/1249] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:02 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:31:03.394882 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d13f129c-1fc8-4b9b-8c82-c59365663880 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:03.395642 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d13f129c-1fc8-4b9b-8c82-c59365663880 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:03.402391 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d13f129c-1fc8-4b9b-8c82-c59365663880 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:03.402836 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d13f129c-1fc8-4b9b-8c82-c59365663880 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:03.403898 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d13f129c-1fc8-4b9b-8c82-c59365663880 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:03.404336 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d13f129c-1fc8-4b9b-8c82-c59365663880 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:03.417790 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-d13f129c-1fc8-4b9b-8c82-c59365663880 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] HTTP exception thrown: Instance 4b2fac49-b603-495e-a648-b56ca6920804 could not be found. Dec 27 14:31:03.418499 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d13f129c-1fc8-4b9b-8c82-c59365663880 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Returning 404 to user: Instance 4b2fac49-b603-495e-a648-b56ca6920804 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:31:03.419366 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d13f129c-1fc8-4b9b-8c82-c59365663880 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804" status: 404 len: 111 microversion: 2.1 time: 0.028524 Dec 27 14:31:03.420235 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 639/1250] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:31:03 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:31:03.422858 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7b7751f7-b9f7-4601-9fa6-7d662b0d8873 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:03.423676 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7b7751f7-b9f7-4601-9fa6-7d662b0d8873 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: a929808f-f43c-4753-b748-dd6d74500c13] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:03.428382 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5ebe4235-350b-4afa-b2e7-c364f735a0ee tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '.version_select at 0x7f802873f4c0>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:03.430201 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b7751f7-b9f7-4601-9fa6-7d662b0d8873 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:03.430673 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b7751f7-b9f7-4601-9fa6-7d662b0d8873 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:03.431452 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b7751f7-b9f7-4601-9fa6-7d662b0d8873 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:03.431923 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7b7751f7-b9f7-4601-9fa6-7d662b0d8873 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:03.447372 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5ebe4235-350b-4afa-b2e7-c364f735a0ee tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1311677689" status: 202 len: 0 microversion: 2.1 time: 0.022344 Dec 27 14:31:03.448021 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 640/1251] 10.222.0.37 () {58 vars in 1220 bytes} [Mon Dec 27 14:31:03 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1311677689 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:31:03.643595 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7b7751f7-b9f7-4601-9fa6-7d662b0d8873 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:03.651203 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7b7751f7-b9f7-4601-9fa6-7d662b0d8873 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13" status: 200 len: 1264 microversion: 2.1 time: 0.232738 Dec 27 14:31:03.651800 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 612/1252] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:31:03 2021] GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13 => generated 1264 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:31:04.105612 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-58488a21-e145-498c-ab1a-cc62a6ce1730 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:04.106527 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-58488a21-e145-498c-ab1a-cc62a6ce1730 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:04.114288 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-58488a21-e145-498c-ab1a-cc62a6ce1730 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:04.114740 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-58488a21-e145-498c-ab1a-cc62a6ce1730 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:04.115542 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-58488a21-e145-498c-ab1a-cc62a6ce1730 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:04.116030 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-58488a21-e145-498c-ab1a-cc62a6ce1730 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:04.283020 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-58488a21-e145-498c-ab1a-cc62a6ce1730 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:04.291682 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-58488a21-e145-498c-ab1a-cc62a6ce1730 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:04.294243 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-58488a21-e145-498c-ab1a-cc62a6ce1730 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:04.296227 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-58488a21-e145-498c-ab1a-cc62a6ce1730 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1740 microversion: 2.20 time: 0.194233 Dec 27 14:31:04.297599 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 641/1253] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:04 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:04.671873 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f679529e-81c4-449c-b35c-9bb540a6811b tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:04.672539 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f679529e-81c4-449c-b35c-9bb540a6811b tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: a929808f-f43c-4753-b748-dd6d74500c13] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:04.679985 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f679529e-81c4-449c-b35c-9bb540a6811b tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:04.680612 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f679529e-81c4-449c-b35c-9bb540a6811b tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:04.681404 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f679529e-81c4-449c-b35c-9bb540a6811b tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:04.682188 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f679529e-81c4-449c-b35c-9bb540a6811b tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:04.847689 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f679529e-81c4-449c-b35c-9bb540a6811b tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:04.856427 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f679529e-81c4-449c-b35c-9bb540a6811b tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13" status: 200 len: 1264 microversion: 2.1 time: 0.191097 Dec 27 14:31:04.857196 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 613/1254] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:31:04 2021] GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13 => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:31:05.323719 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-39cd654d-b4c0-4593-a0d5-3dd8c2a9e30b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:05.325681 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-39cd654d-b4c0-4593-a0d5-3dd8c2a9e30b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:05.337670 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-39cd654d-b4c0-4593-a0d5-3dd8c2a9e30b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:05.338123 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-39cd654d-b4c0-4593-a0d5-3dd8c2a9e30b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:05.338920 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-39cd654d-b4c0-4593-a0d5-3dd8c2a9e30b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:05.339364 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-39cd654d-b4c0-4593-a0d5-3dd8c2a9e30b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:05.536271 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-39cd654d-b4c0-4593-a0d5-3dd8c2a9e30b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:05.544736 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-39cd654d-b4c0-4593-a0d5-3dd8c2a9e30b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:05.546498 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-39cd654d-b4c0-4593-a0d5-3dd8c2a9e30b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:05.548302 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-39cd654d-b4c0-4593-a0d5-3dd8c2a9e30b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1740 microversion: 2.20 time: 0.231001 Dec 27 14:31:05.548847 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 642/1255] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:05 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1740 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:05.881704 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-10e88c8b-93fa-4ff2-95ff-0ec06af24148 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:05.883086 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-10e88c8b-93fa-4ff2-95ff-0ec06af24148 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: a929808f-f43c-4753-b748-dd6d74500c13] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:05.891292 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-10e88c8b-93fa-4ff2-95ff-0ec06af24148 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:05.892088 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-10e88c8b-93fa-4ff2-95ff-0ec06af24148 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:05.893133 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-10e88c8b-93fa-4ff2-95ff-0ec06af24148 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:05.893777 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-10e88c8b-93fa-4ff2-95ff-0ec06af24148 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:06.074961 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-10e88c8b-93fa-4ff2-95ff-0ec06af24148 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:06.085253 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-10e88c8b-93fa-4ff2-95ff-0ec06af24148 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13" status: 200 len: 1264 microversion: 2.1 time: 0.207200 Dec 27 14:31:06.085850 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 614/1256] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:31:05 2021] GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13 => generated 1264 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:31:06.487977 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e55c2a94-13d7-4295-a496-f0c1b862a29b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:06.488512 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e55c2a94-13d7-4295-a496-f0c1b862a29b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:06.494844 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e55c2a94-13d7-4295-a496-f0c1b862a29b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:06.495296 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e55c2a94-13d7-4295-a496-f0c1b862a29b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:06.496304 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e55c2a94-13d7-4295-a496-f0c1b862a29b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:06.496908 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e55c2a94-13d7-4295-a496-f0c1b862a29b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:06.511923 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-e55c2a94-13d7-4295-a496-f0c1b862a29b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] HTTP exception thrown: Instance 4b2fac49-b603-495e-a648-b56ca6920804 could not be found. Dec 27 14:31:06.512625 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e55c2a94-13d7-4295-a496-f0c1b862a29b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Returning 404 to user: Instance 4b2fac49-b603-495e-a648-b56ca6920804 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:31:06.513457 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e55c2a94-13d7-4295-a496-f0c1b862a29b tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "DELETE /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804" status: 404 len: 111 microversion: 2.1 time: 0.029767 Dec 27 14:31:06.514191 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 643/1257] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Dec 27 14:31:06 2021] DELETE /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:31:06.522621 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-df7193ad-aedb-41dd-b7b3-e61fb0a8c7c0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:06.523320 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-df7193ad-aedb-41dd-b7b3-e61fb0a8c7c0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 4b2fac49-b603-495e-a648-b56ca6920804] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:06.530757 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df7193ad-aedb-41dd-b7b3-e61fb0a8c7c0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:06.532089 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df7193ad-aedb-41dd-b7b3-e61fb0a8c7c0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:06.533078 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df7193ad-aedb-41dd-b7b3-e61fb0a8c7c0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:06.533514 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-df7193ad-aedb-41dd-b7b3-e61fb0a8c7c0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:06.547627 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-df7193ad-aedb-41dd-b7b3-e61fb0a8c7c0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] HTTP exception thrown: Instance 4b2fac49-b603-495e-a648-b56ca6920804 could not be found. Dec 27 14:31:06.548991 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-df7193ad-aedb-41dd-b7b3-e61fb0a8c7c0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Returning 404 to user: Instance 4b2fac49-b603-495e-a648-b56ca6920804 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:31:06.550423 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-df7193ad-aedb-41dd-b7b3-e61fb0a8c7c0 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804" status: 404 len: 111 microversion: 2.1 time: 0.031301 Dec 27 14:31:06.551072 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 615/1258] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:31:06 2021] GET /compute/v2.1/servers/4b2fac49-b603-495e-a648-b56ca6920804 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:31:06.572377 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7d059cf5-9fbd-4707-ae8f-8cfd4eeb90c4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:06.573289 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7d059cf5-9fbd-4707-ae8f-8cfd4eeb90c4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:06.579329 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7d059cf5-9fbd-4707-ae8f-8cfd4eeb90c4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:06.580016 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7d059cf5-9fbd-4707-ae8f-8cfd4eeb90c4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:06.580966 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7d059cf5-9fbd-4707-ae8f-8cfd4eeb90c4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:06.581567 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7d059cf5-9fbd-4707-ae8f-8cfd4eeb90c4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:06.754937 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-7d059cf5-9fbd-4707-ae8f-8cfd4eeb90c4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:06.764057 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-7d059cf5-9fbd-4707-ae8f-8cfd4eeb90c4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:06.766020 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-7d059cf5-9fbd-4707-ae8f-8cfd4eeb90c4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:06.767881 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7d059cf5-9fbd-4707-ae8f-8cfd4eeb90c4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1740 microversion: 2.20 time: 0.198583 Dec 27 14:31:06.769853 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 644/1259] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:06 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:07.102710 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d19562e9-66f2-4162-9b23-4930c0ca23b2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:07.103511 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d19562e9-66f2-4162-9b23-4930c0ca23b2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: a929808f-f43c-4753-b748-dd6d74500c13] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:07.112320 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d19562e9-66f2-4162-9b23-4930c0ca23b2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:07.114796 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d19562e9-66f2-4162-9b23-4930c0ca23b2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:07.115606 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d19562e9-66f2-4162-9b23-4930c0ca23b2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:07.116081 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d19562e9-66f2-4162-9b23-4930c0ca23b2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:07.274634 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d19562e9-66f2-4162-9b23-4930c0ca23b2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:07.284339 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d19562e9-66f2-4162-9b23-4930c0ca23b2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13" status: 200 len: 1264 microversion: 2.1 time: 0.185939 Dec 27 14:31:07.285112 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 616/1260] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:31:07 2021] GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13 => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:31:07.705685 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-83dec07a-7cc9-4102-b658-5f5bbc180b48 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:07.706241 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-83dec07a-7cc9-4102-b658-5f5bbc180b48 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:07.712676 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-83dec07a-7cc9-4102-b658-5f5bbc180b48 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:07.713130 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-83dec07a-7cc9-4102-b658-5f5bbc180b48 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:07.713923 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-83dec07a-7cc9-4102-b658-5f5bbc180b48 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:07.723460 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-83dec07a-7cc9-4102-b658-5f5bbc180b48 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:07.755701 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-83dec07a-7cc9-4102-b658-5f5bbc180b48 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] HTTP exception thrown: Instance 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 could not be found. Dec 27 14:31:07.756625 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-83dec07a-7cc9-4102-b658-5f5bbc180b48 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Returning 404 to user: Instance 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:31:07.757683 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-83dec07a-7cc9-4102-b658-5f5bbc180b48 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "DELETE /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 404 len: 111 microversion: 2.1 time: 0.056682 Dec 27 14:31:07.759824 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 645/1261] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Dec 27 14:31:07 2021] DELETE /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:31:07.768178 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-288950e4-f961-4f2b-8c2e-1444267bd1d5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:07.768799 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-288950e4-f961-4f2b-8c2e-1444267bd1d5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] [instance: 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:07.775028 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-288950e4-f961-4f2b-8c2e-1444267bd1d5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:07.775489 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-288950e4-f961-4f2b-8c2e-1444267bd1d5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:07.776326 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-288950e4-f961-4f2b-8c2e-1444267bd1d5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:07.776774 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-288950e4-f961-4f2b-8c2e-1444267bd1d5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:07.787024 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f6dd4ccd-939d-4ee3-8a7b-4bd9aeca2567 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:07.787685 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f6dd4ccd-939d-4ee3-8a7b-4bd9aeca2567 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:07.793917 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f6dd4ccd-939d-4ee3-8a7b-4bd9aeca2567 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:07.794378 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f6dd4ccd-939d-4ee3-8a7b-4bd9aeca2567 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:07.795179 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f6dd4ccd-939d-4ee3-8a7b-4bd9aeca2567 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:07.795619 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f6dd4ccd-939d-4ee3-8a7b-4bd9aeca2567 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:07.815364 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-288950e4-f961-4f2b-8c2e-1444267bd1d5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] HTTP exception thrown: Instance 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 could not be found. Dec 27 14:31:07.816429 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-288950e4-f961-4f2b-8c2e-1444267bd1d5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] Returning 404 to user: Instance 6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:31:07.817897 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-288950e4-f961-4f2b-8c2e-1444267bd1d5 tempest-AttachVolumeTestJSON-501014962 tempest-AttachVolumeTestJSON-501014962-project] 10.222.0.37 "GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4" status: 404 len: 111 microversion: 2.1 time: 0.054261 Dec 27 14:31:07.822015 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 617/1262] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:31:07 2021] GET /compute/v2.1/servers/6f72aa5e-493b-4d61-87f7-7da3af1ab7f4 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:31:07.971152 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f6dd4ccd-939d-4ee3-8a7b-4bd9aeca2567 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:07.980654 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f6dd4ccd-939d-4ee3-8a7b-4bd9aeca2567 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:07.983543 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f6dd4ccd-939d-4ee3-8a7b-4bd9aeca2567 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:07.986054 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f6dd4ccd-939d-4ee3-8a7b-4bd9aeca2567 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1740 microversion: 2.20 time: 0.202787 Dec 27 14:31:07.996641 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 646/1263] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:07 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:08.301896 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e021441c-fabb-4836-9140-afbd3cfda211 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:08.302502 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e021441c-fabb-4836-9140-afbd3cfda211 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: a929808f-f43c-4753-b748-dd6d74500c13] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:08.316514 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e021441c-fabb-4836-9140-afbd3cfda211 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:08.317264 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e021441c-fabb-4836-9140-afbd3cfda211 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:08.318841 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e021441c-fabb-4836-9140-afbd3cfda211 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:08.320424 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e021441c-fabb-4836-9140-afbd3cfda211 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:08.565478 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e021441c-fabb-4836-9140-afbd3cfda211 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:08.574053 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e021441c-fabb-4836-9140-afbd3cfda211 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13" status: 200 len: 1264 microversion: 2.1 time: 0.275662 Dec 27 14:31:08.576203 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 618/1264] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:31:08 2021] GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13 => generated 1264 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:31:09.006185 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-70331e10-6a12-46da-a4c3-cc19f6ae3a47 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:09.007562 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-70331e10-6a12-46da-a4c3-cc19f6ae3a47 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:09.015956 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-70331e10-6a12-46da-a4c3-cc19f6ae3a47 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:09.018055 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-70331e10-6a12-46da-a4c3-cc19f6ae3a47 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:09.019118 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-70331e10-6a12-46da-a4c3-cc19f6ae3a47 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:09.020630 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-70331e10-6a12-46da-a4c3-cc19f6ae3a47 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:09.254677 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-70331e10-6a12-46da-a4c3-cc19f6ae3a47 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:09.263630 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-70331e10-6a12-46da-a4c3-cc19f6ae3a47 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:09.266493 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-70331e10-6a12-46da-a4c3-cc19f6ae3a47 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:09.267684 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-70331e10-6a12-46da-a4c3-cc19f6ae3a47 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1740 microversion: 2.20 time: 0.265836 Dec 27 14:31:09.268807 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 647/1265] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:09 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1740 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:09.598044 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-daec3a9b-1424-4e54-a98e-ae0cfbac0558 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:09.598670 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-daec3a9b-1424-4e54-a98e-ae0cfbac0558 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: a929808f-f43c-4753-b748-dd6d74500c13] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:09.608394 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-daec3a9b-1424-4e54-a98e-ae0cfbac0558 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:09.609213 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-daec3a9b-1424-4e54-a98e-ae0cfbac0558 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:09.611722 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-daec3a9b-1424-4e54-a98e-ae0cfbac0558 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:09.612416 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-daec3a9b-1424-4e54-a98e-ae0cfbac0558 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:09.764836 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-daec3a9b-1424-4e54-a98e-ae0cfbac0558 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:09.773679 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-daec3a9b-1424-4e54-a98e-ae0cfbac0558 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13" status: 200 len: 1264 microversion: 2.1 time: 0.184379 Dec 27 14:31:09.775696 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 619/1266] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:31:09 2021] GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13 => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:31:09.942400 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-2bea9998-7a59-4de4-9615-a9400b01cda6 req-7238e92a-57e1-48de-9cc8-a54ae5a00471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a929808f-f43c-4753-b748-dd6d74500c13", "name": "network-vif-plugged", "status": "completed", "tag": "d2f2dd8e-ec15-4733-83a0-a34345736d8d"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:31:09.945984 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:31:09.945984 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:31:09.962749 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-2bea9998-7a59-4de4-9615-a9400b01cda6 req-7238e92a-57e1-48de-9cc8-a54ae5a00471 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:09.966333 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-2bea9998-7a59-4de4-9615-a9400b01cda6 req-7238e92a-57e1-48de-9cc8-a54ae5a00471 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:09.996075 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-2bea9998-7a59-4de4-9615-a9400b01cda6 req-7238e92a-57e1-48de-9cc8-a54ae5a00471 service nova] Creating event network-vif-plugged:d2f2dd8e-ec15-4733-83a0-a34345736d8d for instance a929808f-f43c-4753-b748-dd6d74500c13 on hv-cinder-82301 Dec 27 14:31:10.007384 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-2bea9998-7a59-4de4-9615-a9400b01cda6 req-7238e92a-57e1-48de-9cc8-a54ae5a00471 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070703 Dec 27 14:31:10.008419 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 648/1267] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:31:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:31:10.289716 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-96f19327-75a1-450b-bde1-5cd68974a80c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:10.290958 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-96f19327-75a1-450b-bde1-5cd68974a80c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:10.303919 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96f19327-75a1-450b-bde1-5cd68974a80c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:10.305938 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96f19327-75a1-450b-bde1-5cd68974a80c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:10.307056 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96f19327-75a1-450b-bde1-5cd68974a80c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:10.311443 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-96f19327-75a1-450b-bde1-5cd68974a80c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:10.568151 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-96f19327-75a1-450b-bde1-5cd68974a80c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:10.576580 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-96f19327-75a1-450b-bde1-5cd68974a80c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:10.581794 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-96f19327-75a1-450b-bde1-5cd68974a80c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:10.584989 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-96f19327-75a1-450b-bde1-5cd68974a80c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1740 microversion: 2.20 time: 0.301533 Dec 27 14:31:10.590099 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 620/1268] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:10 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1740 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:10.793417 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a240a0a9-f06d-4c0e-aa61-40389c0c120b tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:10.794121 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a240a0a9-f06d-4c0e-aa61-40389c0c120b tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: a929808f-f43c-4753-b748-dd6d74500c13] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:10.804896 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a240a0a9-f06d-4c0e-aa61-40389c0c120b tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:10.805634 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a240a0a9-f06d-4c0e-aa61-40389c0c120b tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:10.808497 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a240a0a9-f06d-4c0e-aa61-40389c0c120b tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:10.810663 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a240a0a9-f06d-4c0e-aa61-40389c0c120b tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:11.003770 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a240a0a9-f06d-4c0e-aa61-40389c0c120b tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:11.012399 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a240a0a9-f06d-4c0e-aa61-40389c0c120b tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13" status: 200 len: 1264 microversion: 2.1 time: 0.223116 Dec 27 14:31:11.023189 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 649/1269] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:31:10 2021] GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13 => generated 1264 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:31:11.604347 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dfe8c4d0-5bfa-4069-91d4-4752ddb715f8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:11.605752 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dfe8c4d0-5bfa-4069-91d4-4752ddb715f8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:11.613855 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dfe8c4d0-5bfa-4069-91d4-4752ddb715f8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:11.614624 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dfe8c4d0-5bfa-4069-91d4-4752ddb715f8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:11.615765 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dfe8c4d0-5bfa-4069-91d4-4752ddb715f8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:11.616523 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dfe8c4d0-5bfa-4069-91d4-4752ddb715f8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:11.883976 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-dfe8c4d0-5bfa-4069-91d4-4752ddb715f8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:11.894176 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-dfe8c4d0-5bfa-4069-91d4-4752ddb715f8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:11.898437 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-dfe8c4d0-5bfa-4069-91d4-4752ddb715f8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:11.899634 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dfe8c4d0-5bfa-4069-91d4-4752ddb715f8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1740 microversion: 2.20 time: 0.299111 Dec 27 14:31:11.902499 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 621/1270] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:11 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1740 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:12.030052 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-90158644-88e3-4efb-8c4e-91470998afab tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:12.034950 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-90158644-88e3-4efb-8c4e-91470998afab tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: a929808f-f43c-4753-b748-dd6d74500c13] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:12.044064 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-90158644-88e3-4efb-8c4e-91470998afab tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:12.044958 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-90158644-88e3-4efb-8c4e-91470998afab tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:12.046066 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-90158644-88e3-4efb-8c4e-91470998afab tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:12.047532 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-90158644-88e3-4efb-8c4e-91470998afab tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:12.396914 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-90158644-88e3-4efb-8c4e-91470998afab tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:12.411731 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-90158644-88e3-4efb-8c4e-91470998afab tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13" status: 200 len: 1450 microversion: 2.1 time: 0.385596 Dec 27 14:31:12.423536 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 650/1271] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:31:12 2021] GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13 => generated 1450 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:31:12.428041 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-defd6e0f-0faf-411f-98a5-fc9f34f0a43c tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:12.429018 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-defd6e0f-0faf-411f-98a5-fc9f34f0a43c tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: a929808f-f43c-4753-b748-dd6d74500c13] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:12.443866 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-defd6e0f-0faf-411f-98a5-fc9f34f0a43c tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:12.444576 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-defd6e0f-0faf-411f-98a5-fc9f34f0a43c tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:12.445752 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-defd6e0f-0faf-411f-98a5-fc9f34f0a43c tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:12.446644 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-defd6e0f-0faf-411f-98a5-fc9f34f0a43c tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:12.612298 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-defd6e0f-0faf-411f-98a5-fc9f34f0a43c tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:12.620672 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-defd6e0f-0faf-411f-98a5-fc9f34f0a43c tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13" status: 200 len: 1450 microversion: 2.1 time: 0.195634 Dec 27 14:31:12.621259 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 622/1272] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:31:12 2021] GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13 => generated 1450 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:31:12.923549 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-be9baddf-97da-4d86-bc3b-6b61b24e3616 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:12.924198 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-be9baddf-97da-4d86-bc3b-6b61b24e3616 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:12.931427 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-be9baddf-97da-4d86-bc3b-6b61b24e3616 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:12.931914 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-be9baddf-97da-4d86-bc3b-6b61b24e3616 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:12.945299 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-be9baddf-97da-4d86-bc3b-6b61b24e3616 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:12.945875 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-be9baddf-97da-4d86-bc3b-6b61b24e3616 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:13.128639 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-be9baddf-97da-4d86-bc3b-6b61b24e3616 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:13.138289 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-be9baddf-97da-4d86-bc3b-6b61b24e3616 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:13.139792 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-be9baddf-97da-4d86-bc3b-6b61b24e3616 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:13.143581 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-be9baddf-97da-4d86-bc3b-6b61b24e3616 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1740 microversion: 2.20 time: 0.224293 Dec 27 14:31:13.144739 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 651/1273] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:12 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:14.163492 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c4ca84d1-5907-4016-9c0c-14ca818cc07d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:14.165220 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c4ca84d1-5907-4016-9c0c-14ca818cc07d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:14.174489 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4ca84d1-5907-4016-9c0c-14ca818cc07d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:14.175340 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4ca84d1-5907-4016-9c0c-14ca818cc07d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:14.176413 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4ca84d1-5907-4016-9c0c-14ca818cc07d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:14.184158 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c4ca84d1-5907-4016-9c0c-14ca818cc07d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:14.560751 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c4ca84d1-5907-4016-9c0c-14ca818cc07d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:14.574813 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c4ca84d1-5907-4016-9c0c-14ca818cc07d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:14.577071 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c4ca84d1-5907-4016-9c0c-14ca818cc07d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:14.579139 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c4ca84d1-5907-4016-9c0c-14ca818cc07d tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1740 microversion: 2.20 time: 0.419544 Dec 27 14:31:14.596283 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 623/1274] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:14 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1740 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:31:15.347633 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-56f8e815-c925-49cf-b06c-22bbd0c0f5eb req-0035eb85-2b32-4373-87ad-dc9a21af7ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a929808f-f43c-4753-b748-dd6d74500c13", "tag": "d2f2dd8e-ec15-4733-83a0-a34345736d8d"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:31:15.349812 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:31:15.349812 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:31:15.359582 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-56f8e815-c925-49cf-b06c-22bbd0c0f5eb req-0035eb85-2b32-4373-87ad-dc9a21af7ea8 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:15.361088 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-56f8e815-c925-49cf-b06c-22bbd0c0f5eb req-0035eb85-2b32-4373-87ad-dc9a21af7ea8 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:15.384876 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-56f8e815-c925-49cf-b06c-22bbd0c0f5eb req-0035eb85-2b32-4373-87ad-dc9a21af7ea8 service nova] Creating event network-changed:d2f2dd8e-ec15-4733-83a0-a34345736d8d for instance a929808f-f43c-4753-b748-dd6d74500c13 on hv-cinder-82301 Dec 27 14:31:15.393313 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-56f8e815-c925-49cf-b06c-22bbd0c0f5eb req-0035eb85-2b32-4373-87ad-dc9a21af7ea8 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049909 Dec 27 14:31:15.398649 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 652/1275] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:31:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:31:15.606211 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a8e4b8d5-8bf0-40d1-953d-e3a6b6e65dc4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:15.606884 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a8e4b8d5-8bf0-40d1-953d-e3a6b6e65dc4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:15.617578 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a8e4b8d5-8bf0-40d1-953d-e3a6b6e65dc4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:15.618026 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a8e4b8d5-8bf0-40d1-953d-e3a6b6e65dc4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:15.618879 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a8e4b8d5-8bf0-40d1-953d-e3a6b6e65dc4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:15.619254 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a8e4b8d5-8bf0-40d1-953d-e3a6b6e65dc4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:15.791613 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a8e4b8d5-8bf0-40d1-953d-e3a6b6e65dc4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:15.800809 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a8e4b8d5-8bf0-40d1-953d-e3a6b6e65dc4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:15.802922 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a8e4b8d5-8bf0-40d1-953d-e3a6b6e65dc4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:15.804646 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a8e4b8d5-8bf0-40d1-953d-e3a6b6e65dc4 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1740 microversion: 2.20 time: 0.209939 Dec 27 14:31:15.805629 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 624/1276] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:15 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:16.830645 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8aba1203-7c88-48e4-9aa8-53adeb6977a9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:16.832496 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8aba1203-7c88-48e4-9aa8-53adeb6977a9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:16.841734 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8aba1203-7c88-48e4-9aa8-53adeb6977a9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:16.842277 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8aba1203-7c88-48e4-9aa8-53adeb6977a9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:16.843151 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8aba1203-7c88-48e4-9aa8-53adeb6977a9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:16.844285 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8aba1203-7c88-48e4-9aa8-53adeb6977a9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:17.065048 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8aba1203-7c88-48e4-9aa8-53adeb6977a9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:17.075938 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8aba1203-7c88-48e4-9aa8-53adeb6977a9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:17.077446 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8aba1203-7c88-48e4-9aa8-53adeb6977a9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:17.079094 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8aba1203-7c88-48e4-9aa8-53adeb6977a9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1722 microversion: 2.20 time: 0.253936 Dec 27 14:31:17.089502 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 653/1277] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:16 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:17.471630 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 27 14:31:17.472372 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: Mon Dec 27 14:31:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 27 14:31:18.097392 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c83d9102-cb47-434e-aa97-d6bd394f3ea7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:18.098108 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c83d9102-cb47-434e-aa97-d6bd394f3ea7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:18.104812 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c83d9102-cb47-434e-aa97-d6bd394f3ea7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:18.105263 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c83d9102-cb47-434e-aa97-d6bd394f3ea7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:18.106046 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c83d9102-cb47-434e-aa97-d6bd394f3ea7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:18.106474 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c83d9102-cb47-434e-aa97-d6bd394f3ea7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:18.241691 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c83d9102-cb47-434e-aa97-d6bd394f3ea7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:18.250669 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c83d9102-cb47-434e-aa97-d6bd394f3ea7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:18.252184 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c83d9102-cb47-434e-aa97-d6bd394f3ea7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:18.253341 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c83d9102-cb47-434e-aa97-d6bd394f3ea7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1722 microversion: 2.20 time: 0.160120 Dec 27 14:31:18.253879 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 625/1278] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:18 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:19.270872 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a7d517a1-a5fa-4823-9727-2fc73ce2db08 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:19.271708 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a7d517a1-a5fa-4823-9727-2fc73ce2db08 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:19.278519 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a7d517a1-a5fa-4823-9727-2fc73ce2db08 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:19.278976 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a7d517a1-a5fa-4823-9727-2fc73ce2db08 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:19.279739 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a7d517a1-a5fa-4823-9727-2fc73ce2db08 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:19.280196 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a7d517a1-a5fa-4823-9727-2fc73ce2db08 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:19.418347 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a7d517a1-a5fa-4823-9727-2fc73ce2db08 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:19.426958 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a7d517a1-a5fa-4823-9727-2fc73ce2db08 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:19.428477 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a7d517a1-a5fa-4823-9727-2fc73ce2db08 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:19.429627 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a7d517a1-a5fa-4823-9727-2fc73ce2db08 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1725 microversion: 2.20 time: 0.163106 Dec 27 14:31:19.430186 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 654/1279] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:19 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:19.447655 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b7a5ddb0-f919-435a-a86e-1c545a65f409 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14bdca27-12af-4b6d-9bc4-12d49aebc0bc"}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:31:19.448817 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b7a5ddb0-f919-435a-a86e-1c545a65f409 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:19.456159 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b7a5ddb0-f919-435a-a86e-1c545a65f409 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:19.456615 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b7a5ddb0-f919-435a-a86e-1c545a65f409 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:19.457405 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b7a5ddb0-f919-435a-a86e-1c545a65f409 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:19.457861 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b7a5ddb0-f919-435a-a86e-1c545a65f409 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:19.710925 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b7a5ddb0-f919-435a-a86e-1c545a65f409 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.267176 Dec 27 14:31:19.711529 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 626/1280] 10.222.0.37 () {62 vars in 1363 bytes} [Mon Dec 27 14:31:19 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/os-volume_attachments => generated 188 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 27 14:31:19.794690 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-d431ea7d-02ca-43a0-9250-e1354d0941ce req-1e33a83f-e3a2-48da-8ec9-a2112d3e0df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f23091f-27bc-4397-ad23-c7aeafafb970", "name": "network-vif-unplugged", "status": "completed", "tag": "d5856f9b-e239-4613-88a7-d15a19d0765d"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:31:19.796232 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:31:19.796232 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:31:19.803898 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-d431ea7d-02ca-43a0-9250-e1354d0941ce req-1e33a83f-e3a2-48da-8ec9-a2112d3e0df8 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:19.804352 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-d431ea7d-02ca-43a0-9250-e1354d0941ce req-1e33a83f-e3a2-48da-8ec9-a2112d3e0df8 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:19.815540 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.compute.server_external_events [req-d431ea7d-02ca-43a0-9250-e1354d0941ce req-1e33a83f-e3a2-48da-8ec9-a2112d3e0df8 service nova] Unable to find a host for instance 5f23091f-27bc-4397-ad23-c7aeafafb970. Dropping event network-vif-unplugged {{(pid=116105) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 27 14:31:19.816451 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-d431ea7d-02ca-43a0-9250-e1354d0941ce req-1e33a83f-e3a2-48da-8ec9-a2112d3e0df8 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025904 Dec 27 14:31:19.817095 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 655/1281] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:31:19 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 27 14:31:19.825763 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-09d2245f-05a0-4bfa-9faf-f96633c8f241 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:19.826259 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-09d2245f-05a0-4bfa-9faf-f96633c8f241 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:19.832761 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-09d2245f-05a0-4bfa-9faf-f96633c8f241 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:19.833202 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-09d2245f-05a0-4bfa-9faf-f96633c8f241 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:19.834066 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-09d2245f-05a0-4bfa-9faf-f96633c8f241 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:19.834534 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-09d2245f-05a0-4bfa-9faf-f96633c8f241 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:20.200310 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-09d2245f-05a0-4bfa-9faf-f96633c8f241 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "DELETE /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/os-volume_attachments/14bdca27-12af-4b6d-9bc4-12d49aebc0bc" status: 202 len: 0 microversion: 2.20 time: 0.378239 Dec 27 14:31:20.200896 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 627/1282] 10.222.0.37 () {60 vars in 1456 bytes} [Mon Dec 27 14:31:19 2021] DELETE /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/os-volume_attachments/14bdca27-12af-4b6d-9bc4-12d49aebc0bc => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 27 14:31:20.255821 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5dded0f9-d3da-4d05-a21c-07da5157842b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:31:20.256454 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5dded0f9-d3da-4d05-a21c-07da5157842b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:20.262332 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5dded0f9-d3da-4d05-a21c-07da5157842b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:20.262784 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5dded0f9-d3da-4d05-a21c-07da5157842b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:20.263560 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5dded0f9-d3da-4d05-a21c-07da5157842b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:20.264068 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5dded0f9-d3da-4d05-a21c-07da5157842b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:20.340168 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5dded0f9-d3da-4d05-a21c-07da5157842b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action" status: 202 len: 0 microversion: 2.20 time: 0.087951 Dec 27 14:31:20.340880 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 656/1283] 10.222.0.37 () {62 vars in 1318 bytes} [Mon Dec 27 14:31:20 2021] POST /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 27 14:31:20.348741 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e323bb76-f391-4e00-b636-5d36f71b6628 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:20.349385 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e323bb76-f391-4e00-b636-5d36f71b6628 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:20.355176 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e323bb76-f391-4e00-b636-5d36f71b6628 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:20.355623 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e323bb76-f391-4e00-b636-5d36f71b6628 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:20.356446 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e323bb76-f391-4e00-b636-5d36f71b6628 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:20.356882 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e323bb76-f391-4e00-b636-5d36f71b6628 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:20.492416 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e323bb76-f391-4e00-b636-5d36f71b6628 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:20.500882 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e323bb76-f391-4e00-b636-5d36f71b6628 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:20.502519 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e323bb76-f391-4e00-b636-5d36f71b6628 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:20.503772 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e323bb76-f391-4e00-b636-5d36f71b6628 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1673 microversion: 2.20 time: 0.158795 Dec 27 14:31:20.504447 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 628/1284] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:20 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:21.522736 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-be476584-d68f-4923-81ff-171ab0aadf57 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:21.523349 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-be476584-d68f-4923-81ff-171ab0aadf57 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:21.529659 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-be476584-d68f-4923-81ff-171ab0aadf57 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:21.530109 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-be476584-d68f-4923-81ff-171ab0aadf57 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:21.531169 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-be476584-d68f-4923-81ff-171ab0aadf57 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:21.531607 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-be476584-d68f-4923-81ff-171ab0aadf57 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:21.661763 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-be476584-d68f-4923-81ff-171ab0aadf57 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:21.669376 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-be476584-d68f-4923-81ff-171ab0aadf57 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:21.670861 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-be476584-d68f-4923-81ff-171ab0aadf57 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:21.672172 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-be476584-d68f-4923-81ff-171ab0aadf57 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1673 microversion: 2.20 time: 0.153596 Dec 27 14:31:21.672742 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 657/1285] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:21 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:22.689663 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f8d0588e-b757-42c0-967b-ece0bcdb1f76 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:22.690291 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f8d0588e-b757-42c0-967b-ece0bcdb1f76 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:22.696585 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f8d0588e-b757-42c0-967b-ece0bcdb1f76 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:22.697029 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f8d0588e-b757-42c0-967b-ece0bcdb1f76 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:22.697807 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f8d0588e-b757-42c0-967b-ece0bcdb1f76 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:22.698233 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f8d0588e-b757-42c0-967b-ece0bcdb1f76 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:22.825879 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f8d0588e-b757-42c0-967b-ece0bcdb1f76 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:22.834461 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f8d0588e-b757-42c0-967b-ece0bcdb1f76 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:22.835990 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f8d0588e-b757-42c0-967b-ece0bcdb1f76 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:22.837136 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f8d0588e-b757-42c0-967b-ece0bcdb1f76 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1675 microversion: 2.20 time: 0.151129 Dec 27 14:31:22.837695 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 629/1286] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:22 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:23.855694 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5636415a-6bc8-4e49-8240-76fbc0a04c29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:23.856338 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5636415a-6bc8-4e49-8240-76fbc0a04c29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:23.863336 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5636415a-6bc8-4e49-8240-76fbc0a04c29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:23.863793 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5636415a-6bc8-4e49-8240-76fbc0a04c29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:23.864683 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5636415a-6bc8-4e49-8240-76fbc0a04c29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:23.865121 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5636415a-6bc8-4e49-8240-76fbc0a04c29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:24.018519 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5636415a-6bc8-4e49-8240-76fbc0a04c29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:24.026263 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5636415a-6bc8-4e49-8240-76fbc0a04c29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:24.027741 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5636415a-6bc8-4e49-8240-76fbc0a04c29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:24.029171 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5636415a-6bc8-4e49-8240-76fbc0a04c29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1675 microversion: 2.20 time: 0.177222 Dec 27 14:31:24.029729 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 658/1287] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:23 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:25.046476 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-862c1b8e-4013-43e6-9aab-d331ae8fb767 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:25.047088 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-862c1b8e-4013-43e6-9aab-d331ae8fb767 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:25.053345 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-862c1b8e-4013-43e6-9aab-d331ae8fb767 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:25.053799 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-862c1b8e-4013-43e6-9aab-d331ae8fb767 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:25.054582 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-862c1b8e-4013-43e6-9aab-d331ae8fb767 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:25.055081 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-862c1b8e-4013-43e6-9aab-d331ae8fb767 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:25.189090 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-862c1b8e-4013-43e6-9aab-d331ae8fb767 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:25.196863 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-862c1b8e-4013-43e6-9aab-d331ae8fb767 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:25.198432 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-862c1b8e-4013-43e6-9aab-d331ae8fb767 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:25.199591 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-862c1b8e-4013-43e6-9aab-d331ae8fb767 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.157033 Dec 27 14:31:25.200232 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 630/1288] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:25 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:26.217924 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d42e9296-8b60-4a47-9cd2-71002f411934 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:26.218545 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d42e9296-8b60-4a47-9cd2-71002f411934 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:26.225427 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d42e9296-8b60-4a47-9cd2-71002f411934 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:26.225881 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d42e9296-8b60-4a47-9cd2-71002f411934 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:26.226679 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d42e9296-8b60-4a47-9cd2-71002f411934 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:26.227119 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d42e9296-8b60-4a47-9cd2-71002f411934 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:26.369780 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d42e9296-8b60-4a47-9cd2-71002f411934 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:26.378058 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d42e9296-8b60-4a47-9cd2-71002f411934 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:26.379560 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d42e9296-8b60-4a47-9cd2-71002f411934 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:26.380759 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d42e9296-8b60-4a47-9cd2-71002f411934 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.166706 Dec 27 14:31:26.381332 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 659/1289] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:26 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:27.398424 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5fdd3992-8b99-4da4-8ca4-64e6eda2439e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:27.398990 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5fdd3992-8b99-4da4-8ca4-64e6eda2439e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:27.405544 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5fdd3992-8b99-4da4-8ca4-64e6eda2439e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:27.405997 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5fdd3992-8b99-4da4-8ca4-64e6eda2439e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:27.406777 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5fdd3992-8b99-4da4-8ca4-64e6eda2439e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:27.407215 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5fdd3992-8b99-4da4-8ca4-64e6eda2439e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:27.539685 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5fdd3992-8b99-4da4-8ca4-64e6eda2439e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:27.549127 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5fdd3992-8b99-4da4-8ca4-64e6eda2439e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:27.550650 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5fdd3992-8b99-4da4-8ca4-64e6eda2439e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:27.551854 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5fdd3992-8b99-4da4-8ca4-64e6eda2439e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.157197 Dec 27 14:31:27.552467 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 631/1290] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:27 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:28.570204 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-948637de-d1a7-440f-a5e2-109c9ba115c0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:28.570793 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-948637de-d1a7-440f-a5e2-109c9ba115c0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:28.577077 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-948637de-d1a7-440f-a5e2-109c9ba115c0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:28.577851 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-948637de-d1a7-440f-a5e2-109c9ba115c0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:28.578625 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-948637de-d1a7-440f-a5e2-109c9ba115c0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:28.579055 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-948637de-d1a7-440f-a5e2-109c9ba115c0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:28.713873 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-948637de-d1a7-440f-a5e2-109c9ba115c0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:28.722259 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-948637de-d1a7-440f-a5e2-109c9ba115c0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:28.723746 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-948637de-d1a7-440f-a5e2-109c9ba115c0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:28.724960 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-948637de-d1a7-440f-a5e2-109c9ba115c0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.158385 Dec 27 14:31:28.725523 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 660/1291] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:28 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:29.743477 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b431852f-67ac-4e4c-a081-620dc8f83873 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:29.744115 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b431852f-67ac-4e4c-a081-620dc8f83873 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:29.751352 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b431852f-67ac-4e4c-a081-620dc8f83873 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:29.751806 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b431852f-67ac-4e4c-a081-620dc8f83873 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:29.752620 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b431852f-67ac-4e4c-a081-620dc8f83873 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:29.753134 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b431852f-67ac-4e4c-a081-620dc8f83873 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:29.890715 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b431852f-67ac-4e4c-a081-620dc8f83873 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:29.898722 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b431852f-67ac-4e4c-a081-620dc8f83873 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:29.900243 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b431852f-67ac-4e4c-a081-620dc8f83873 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:29.901937 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b431852f-67ac-4e4c-a081-620dc8f83873 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.162184 Dec 27 14:31:29.914026 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 632/1292] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:29 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:30.922622 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-27bac15b-7b61-4d04-bd99-2c0ba53853cb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:30.923240 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-27bac15b-7b61-4d04-bd99-2c0ba53853cb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:30.929111 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-27bac15b-7b61-4d04-bd99-2c0ba53853cb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:30.929552 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-27bac15b-7b61-4d04-bd99-2c0ba53853cb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:30.930443 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-27bac15b-7b61-4d04-bd99-2c0ba53853cb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:30.930941 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-27bac15b-7b61-4d04-bd99-2c0ba53853cb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:31.061881 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-27bac15b-7b61-4d04-bd99-2c0ba53853cb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:31.069897 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-27bac15b-7b61-4d04-bd99-2c0ba53853cb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:31.071310 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-27bac15b-7b61-4d04-bd99-2c0ba53853cb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:31.072495 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-27bac15b-7b61-4d04-bd99-2c0ba53853cb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.154756 Dec 27 14:31:31.073053 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 661/1293] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:30 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:32.091017 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f9384cef-ff34-4814-8f9f-81f98132ae14 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:32.091553 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f9384cef-ff34-4814-8f9f-81f98132ae14 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:32.099013 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f9384cef-ff34-4814-8f9f-81f98132ae14 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:32.099484 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f9384cef-ff34-4814-8f9f-81f98132ae14 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:32.100290 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f9384cef-ff34-4814-8f9f-81f98132ae14 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:32.100721 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f9384cef-ff34-4814-8f9f-81f98132ae14 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:32.238947 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f9384cef-ff34-4814-8f9f-81f98132ae14 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:32.249911 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f9384cef-ff34-4814-8f9f-81f98132ae14 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:32.252301 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f9384cef-ff34-4814-8f9f-81f98132ae14 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:32.254095 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f9384cef-ff34-4814-8f9f-81f98132ae14 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.166878 Dec 27 14:31:32.254762 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 633/1294] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:32 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:31:33.274314 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ccb858b7-47e4-490a-917f-b5748f01ee3c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:33.274973 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ccb858b7-47e4-490a-917f-b5748f01ee3c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:33.281558 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ccb858b7-47e4-490a-917f-b5748f01ee3c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:33.282013 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ccb858b7-47e4-490a-917f-b5748f01ee3c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:33.282789 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ccb858b7-47e4-490a-917f-b5748f01ee3c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:33.283225 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ccb858b7-47e4-490a-917f-b5748f01ee3c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:33.421857 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ccb858b7-47e4-490a-917f-b5748f01ee3c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:33.429780 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ccb858b7-47e4-490a-917f-b5748f01ee3c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:33.431269 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ccb858b7-47e4-490a-917f-b5748f01ee3c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:33.432497 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ccb858b7-47e4-490a-917f-b5748f01ee3c tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.161870 Dec 27 14:31:33.433069 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 662/1295] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:33 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:34.451416 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-767d4fc1-a5e2-422d-a4fe-020458d058e2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:34.452977 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-767d4fc1-a5e2-422d-a4fe-020458d058e2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:34.459811 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-767d4fc1-a5e2-422d-a4fe-020458d058e2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:34.460283 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-767d4fc1-a5e2-422d-a4fe-020458d058e2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:34.461077 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-767d4fc1-a5e2-422d-a4fe-020458d058e2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:34.461512 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-767d4fc1-a5e2-422d-a4fe-020458d058e2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:34.595320 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-767d4fc1-a5e2-422d-a4fe-020458d058e2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:34.602942 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-767d4fc1-a5e2-422d-a4fe-020458d058e2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:34.604461 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-767d4fc1-a5e2-422d-a4fe-020458d058e2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:34.605596 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-767d4fc1-a5e2-422d-a4fe-020458d058e2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.158317 Dec 27 14:31:34.606148 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 634/1296] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:34 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:35.623822 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9ddf882c-a27c-4409-9074-928357b700b1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:35.624770 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9ddf882c-a27c-4409-9074-928357b700b1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:35.631300 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ddf882c-a27c-4409-9074-928357b700b1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:35.631774 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ddf882c-a27c-4409-9074-928357b700b1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:35.632587 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ddf882c-a27c-4409-9074-928357b700b1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:35.633049 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ddf882c-a27c-4409-9074-928357b700b1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:35.763326 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9ddf882c-a27c-4409-9074-928357b700b1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:35.771019 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9ddf882c-a27c-4409-9074-928357b700b1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:35.772586 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9ddf882c-a27c-4409-9074-928357b700b1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:35.773754 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9ddf882c-a27c-4409-9074-928357b700b1 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.153793 Dec 27 14:31:35.774330 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 663/1297] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:35 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:36.791737 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-32be5eb3-1487-415e-99fd-9e349b7dfebc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:36.792453 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-32be5eb3-1487-415e-99fd-9e349b7dfebc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:36.798991 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32be5eb3-1487-415e-99fd-9e349b7dfebc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:36.799442 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32be5eb3-1487-415e-99fd-9e349b7dfebc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:36.800313 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32be5eb3-1487-415e-99fd-9e349b7dfebc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:36.800779 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-32be5eb3-1487-415e-99fd-9e349b7dfebc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:36.929771 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-32be5eb3-1487-415e-99fd-9e349b7dfebc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:36.938263 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-32be5eb3-1487-415e-99fd-9e349b7dfebc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:36.939768 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-32be5eb3-1487-415e-99fd-9e349b7dfebc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:36.940952 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-32be5eb3-1487-415e-99fd-9e349b7dfebc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.152948 Dec 27 14:31:36.941511 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 635/1298] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:36 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:37.959126 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4eca0e79-6318-4946-9ce3-ad52b22626cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:37.959818 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4eca0e79-6318-4946-9ce3-ad52b22626cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:37.966335 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4eca0e79-6318-4946-9ce3-ad52b22626cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:37.967048 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4eca0e79-6318-4946-9ce3-ad52b22626cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:37.968153 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4eca0e79-6318-4946-9ce3-ad52b22626cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:37.968789 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4eca0e79-6318-4946-9ce3-ad52b22626cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:38.165901 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4eca0e79-6318-4946-9ce3-ad52b22626cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:38.174348 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4eca0e79-6318-4946-9ce3-ad52b22626cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:38.175923 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4eca0e79-6318-4946-9ce3-ad52b22626cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:38.177098 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4eca0e79-6318-4946-9ce3-ad52b22626cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.221669 Dec 27 14:31:38.177666 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 664/1299] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:37 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:39.195284 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-437b437e-0df4-4ffd-a5c7-583408736b3a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:39.196036 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-437b437e-0df4-4ffd-a5c7-583408736b3a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:39.203387 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-437b437e-0df4-4ffd-a5c7-583408736b3a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:39.203867 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-437b437e-0df4-4ffd-a5c7-583408736b3a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:39.204676 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-437b437e-0df4-4ffd-a5c7-583408736b3a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:39.205124 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-437b437e-0df4-4ffd-a5c7-583408736b3a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:39.409958 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-437b437e-0df4-4ffd-a5c7-583408736b3a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:39.417769 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-437b437e-0df4-4ffd-a5c7-583408736b3a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:39.419266 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-437b437e-0df4-4ffd-a5c7-583408736b3a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:39.421007 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-437b437e-0df4-4ffd-a5c7-583408736b3a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.228827 Dec 27 14:31:39.421597 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 636/1300] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:39 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:40.438907 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1cfb231c-0e36-4e3b-b3e5-9672d8e2ed29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:40.439513 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1cfb231c-0e36-4e3b-b3e5-9672d8e2ed29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:40.445793 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1cfb231c-0e36-4e3b-b3e5-9672d8e2ed29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:40.446249 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1cfb231c-0e36-4e3b-b3e5-9672d8e2ed29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:40.447030 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1cfb231c-0e36-4e3b-b3e5-9672d8e2ed29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:40.447474 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1cfb231c-0e36-4e3b-b3e5-9672d8e2ed29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:40.576459 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1cfb231c-0e36-4e3b-b3e5-9672d8e2ed29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:40.585701 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1cfb231c-0e36-4e3b-b3e5-9672d8e2ed29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:40.587285 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1cfb231c-0e36-4e3b-b3e5-9672d8e2ed29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:40.588638 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1cfb231c-0e36-4e3b-b3e5-9672d8e2ed29 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.153975 Dec 27 14:31:40.589591 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 665/1301] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:40 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:41.607216 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-41321afb-93bd-49fd-8219-fdc12cb260b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:41.608395 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-41321afb-93bd-49fd-8219-fdc12cb260b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:41.615032 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41321afb-93bd-49fd-8219-fdc12cb260b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:41.615754 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41321afb-93bd-49fd-8219-fdc12cb260b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:41.616878 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41321afb-93bd-49fd-8219-fdc12cb260b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:41.617323 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41321afb-93bd-49fd-8219-fdc12cb260b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:41.759843 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-41321afb-93bd-49fd-8219-fdc12cb260b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:41.768029 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-41321afb-93bd-49fd-8219-fdc12cb260b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:41.769530 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-41321afb-93bd-49fd-8219-fdc12cb260b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:41.770682 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-41321afb-93bd-49fd-8219-fdc12cb260b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.167282 Dec 27 14:31:41.771238 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 637/1302] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:41 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:42.789942 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3537e475-1f49-4ac8-809d-4f714ce11941 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:42.790457 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3537e475-1f49-4ac8-809d-4f714ce11941 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:42.798550 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3537e475-1f49-4ac8-809d-4f714ce11941 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:42.799085 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3537e475-1f49-4ac8-809d-4f714ce11941 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:42.800461 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3537e475-1f49-4ac8-809d-4f714ce11941 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:42.800900 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3537e475-1f49-4ac8-809d-4f714ce11941 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:42.941545 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3537e475-1f49-4ac8-809d-4f714ce11941 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:42.949247 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3537e475-1f49-4ac8-809d-4f714ce11941 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:42.950753 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3537e475-1f49-4ac8-809d-4f714ce11941 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:42.952529 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3537e475-1f49-4ac8-809d-4f714ce11941 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.166813 Dec 27 14:31:42.953099 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 666/1303] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:42 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:43.971076 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-71aaa5a7-52a2-46fb-8269-08ff7bddc93b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:43.971607 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-71aaa5a7-52a2-46fb-8269-08ff7bddc93b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:43.977888 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71aaa5a7-52a2-46fb-8269-08ff7bddc93b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:43.978339 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71aaa5a7-52a2-46fb-8269-08ff7bddc93b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:43.979125 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71aaa5a7-52a2-46fb-8269-08ff7bddc93b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:43.979567 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-71aaa5a7-52a2-46fb-8269-08ff7bddc93b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:44.106998 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-71aaa5a7-52a2-46fb-8269-08ff7bddc93b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:44.115337 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-71aaa5a7-52a2-46fb-8269-08ff7bddc93b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:44.116864 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-71aaa5a7-52a2-46fb-8269-08ff7bddc93b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:44.118012 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-71aaa5a7-52a2-46fb-8269-08ff7bddc93b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.151426 Dec 27 14:31:44.118580 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 638/1304] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:43 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:45.136589 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ce1fa528-f5b9-4536-afaf-6e702b50a6b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:45.137116 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ce1fa528-f5b9-4536-afaf-6e702b50a6b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:45.143822 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce1fa528-f5b9-4536-afaf-6e702b50a6b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:45.144293 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce1fa528-f5b9-4536-afaf-6e702b50a6b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:45.145066 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce1fa528-f5b9-4536-afaf-6e702b50a6b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:45.145497 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce1fa528-f5b9-4536-afaf-6e702b50a6b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:45.274534 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ce1fa528-f5b9-4536-afaf-6e702b50a6b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:45.283142 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ce1fa528-f5b9-4536-afaf-6e702b50a6b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:45.284674 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ce1fa528-f5b9-4536-afaf-6e702b50a6b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:45.285836 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ce1fa528-f5b9-4536-afaf-6e702b50a6b5 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.153041 Dec 27 14:31:45.286406 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 667/1305] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:45 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:46.303522 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d32ef974-4fb2-4714-8080-efdf305f6723 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:46.304182 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d32ef974-4fb2-4714-8080-efdf305f6723 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:46.310428 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d32ef974-4fb2-4714-8080-efdf305f6723 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:46.311662 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d32ef974-4fb2-4714-8080-efdf305f6723 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:46.312475 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d32ef974-4fb2-4714-8080-efdf305f6723 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:46.312906 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d32ef974-4fb2-4714-8080-efdf305f6723 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:46.440455 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d32ef974-4fb2-4714-8080-efdf305f6723 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:46.448056 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d32ef974-4fb2-4714-8080-efdf305f6723 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:46.449540 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d32ef974-4fb2-4714-8080-efdf305f6723 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:46.450669 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d32ef974-4fb2-4714-8080-efdf305f6723 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.150829 Dec 27 14:31:46.451221 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 639/1306] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:46 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:47.469032 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-1f34771e-6fe1-4fb1-a9b2-57c2a50b18ac tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:47.469629 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-1f34771e-6fe1-4fb1-a9b2-57c2a50b18ac tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:47.476137 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1f34771e-6fe1-4fb1-a9b2-57c2a50b18ac tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:47.476749 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1f34771e-6fe1-4fb1-a9b2-57c2a50b18ac tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:47.477530 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1f34771e-6fe1-4fb1-a9b2-57c2a50b18ac tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:47.477963 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-1f34771e-6fe1-4fb1-a9b2-57c2a50b18ac tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:47.602571 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1f34771e-6fe1-4fb1-a9b2-57c2a50b18ac tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:47.610716 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1f34771e-6fe1-4fb1-a9b2-57c2a50b18ac tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:47.612262 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-1f34771e-6fe1-4fb1-a9b2-57c2a50b18ac tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:47.613418 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-1f34771e-6fe1-4fb1-a9b2-57c2a50b18ac tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.148687 Dec 27 14:31:47.613985 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 668/1307] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:47 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:48.630859 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-904fa177-4ca7-441c-bcdc-7868e755f13a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:48.631465 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-904fa177-4ca7-441c-bcdc-7868e755f13a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:48.637890 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-904fa177-4ca7-441c-bcdc-7868e755f13a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:48.638341 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-904fa177-4ca7-441c-bcdc-7868e755f13a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:48.639345 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-904fa177-4ca7-441c-bcdc-7868e755f13a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:48.639793 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-904fa177-4ca7-441c-bcdc-7868e755f13a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:48.772173 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-904fa177-4ca7-441c-bcdc-7868e755f13a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:48.780621 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-904fa177-4ca7-441c-bcdc-7868e755f13a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:48.782113 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-904fa177-4ca7-441c-bcdc-7868e755f13a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:48.783260 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-904fa177-4ca7-441c-bcdc-7868e755f13a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.156206 Dec 27 14:31:48.783817 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 640/1308] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:48 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:49.801479 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-46aa2d3d-403f-49e2-b001-835bd0eab5b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:49.802108 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-46aa2d3d-403f-49e2-b001-835bd0eab5b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:49.808443 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-46aa2d3d-403f-49e2-b001-835bd0eab5b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:49.808896 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-46aa2d3d-403f-49e2-b001-835bd0eab5b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:49.809672 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-46aa2d3d-403f-49e2-b001-835bd0eab5b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:49.810109 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-46aa2d3d-403f-49e2-b001-835bd0eab5b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:49.940486 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-46aa2d3d-403f-49e2-b001-835bd0eab5b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:49.948263 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-46aa2d3d-403f-49e2-b001-835bd0eab5b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:49.949768 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-46aa2d3d-403f-49e2-b001-835bd0eab5b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:49.950929 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-46aa2d3d-403f-49e2-b001-835bd0eab5b7 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.153366 Dec 27 14:31:49.952072 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 669/1309] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:49 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:50.970102 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-77ecb0fb-764f-4f29-8293-b38ffb16caf0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:50.970706 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-77ecb0fb-764f-4f29-8293-b38ffb16caf0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:50.977496 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-77ecb0fb-764f-4f29-8293-b38ffb16caf0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:50.977942 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-77ecb0fb-764f-4f29-8293-b38ffb16caf0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:50.978732 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-77ecb0fb-764f-4f29-8293-b38ffb16caf0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:50.979164 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-77ecb0fb-764f-4f29-8293-b38ffb16caf0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:51.109421 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-77ecb0fb-764f-4f29-8293-b38ffb16caf0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:51.117088 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-77ecb0fb-764f-4f29-8293-b38ffb16caf0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:51.118577 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-77ecb0fb-764f-4f29-8293-b38ffb16caf0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:51.119714 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-77ecb0fb-764f-4f29-8293-b38ffb16caf0 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.154088 Dec 27 14:31:51.120307 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 641/1310] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:50 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:52.137444 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f9ec6c85-0f14-45d8-b8ed-808b10eb12d8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:52.139019 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f9ec6c85-0f14-45d8-b8ed-808b10eb12d8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:52.145552 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f9ec6c85-0f14-45d8-b8ed-808b10eb12d8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:52.145745 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f9ec6c85-0f14-45d8-b8ed-808b10eb12d8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:52.146530 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f9ec6c85-0f14-45d8-b8ed-808b10eb12d8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:52.146960 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f9ec6c85-0f14-45d8-b8ed-808b10eb12d8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:52.278553 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f9ec6c85-0f14-45d8-b8ed-808b10eb12d8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:52.287056 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f9ec6c85-0f14-45d8-b8ed-808b10eb12d8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:52.288596 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-f9ec6c85-0f14-45d8-b8ed-808b10eb12d8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:52.289743 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f9ec6c85-0f14-45d8-b8ed-808b10eb12d8 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.156044 Dec 27 14:31:52.290314 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 670/1311] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:52 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:53.307528 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-db4b6016-c5c1-436a-8adc-62c683ddcc8a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:53.308165 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-db4b6016-c5c1-436a-8adc-62c683ddcc8a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:53.315155 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db4b6016-c5c1-436a-8adc-62c683ddcc8a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:53.315602 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db4b6016-c5c1-436a-8adc-62c683ddcc8a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:53.316437 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db4b6016-c5c1-436a-8adc-62c683ddcc8a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:53.316874 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-db4b6016-c5c1-436a-8adc-62c683ddcc8a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:53.451801 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-db4b6016-c5c1-436a-8adc-62c683ddcc8a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:53.459608 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-db4b6016-c5c1-436a-8adc-62c683ddcc8a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:53.461152 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-db4b6016-c5c1-436a-8adc-62c683ddcc8a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:53.462294 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-db4b6016-c5c1-436a-8adc-62c683ddcc8a tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.158452 Dec 27 14:31:53.462842 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 642/1312] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:53 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:54.480966 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-6e3c481b-0a80-4cc1-8fbb-390c8777924e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:54.481590 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-6e3c481b-0a80-4cc1-8fbb-390c8777924e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:54.488318 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6e3c481b-0a80-4cc1-8fbb-390c8777924e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:54.488769 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6e3c481b-0a80-4cc1-8fbb-390c8777924e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:54.489553 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6e3c481b-0a80-4cc1-8fbb-390c8777924e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:54.489974 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-6e3c481b-0a80-4cc1-8fbb-390c8777924e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:54.621773 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6e3c481b-0a80-4cc1-8fbb-390c8777924e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:54.629589 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6e3c481b-0a80-4cc1-8fbb-390c8777924e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:54.631065 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-6e3c481b-0a80-4cc1-8fbb-390c8777924e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:54.632237 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-6e3c481b-0a80-4cc1-8fbb-390c8777924e tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.154962 Dec 27 14:31:54.632794 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 671/1313] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:54 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:55.650160 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-cbb1ebe9-8d2f-4c4c-b886-5fd341c013a6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:55.650765 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-cbb1ebe9-8d2f-4c4c-b886-5fd341c013a6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:55.657295 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cbb1ebe9-8d2f-4c4c-b886-5fd341c013a6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:55.657737 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cbb1ebe9-8d2f-4c4c-b886-5fd341c013a6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:55.658508 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cbb1ebe9-8d2f-4c4c-b886-5fd341c013a6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:55.658940 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-cbb1ebe9-8d2f-4c4c-b886-5fd341c013a6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:55.790474 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cbb1ebe9-8d2f-4c4c-b886-5fd341c013a6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:55.799089 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cbb1ebe9-8d2f-4c4c-b886-5fd341c013a6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:55.800748 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-cbb1ebe9-8d2f-4c4c-b886-5fd341c013a6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:55.801957 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-cbb1ebe9-8d2f-4c4c-b886-5fd341c013a6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.155500 Dec 27 14:31:55.802673 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 643/1314] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:55 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:56.058053 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-7b1a8ebb-113c-40bb-b192-e9dbdf39d4cd req-98005e93-48e6-4a71-bca5-2b99b8cd6b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f23091f-27bc-4397-ad23-c7aeafafb970", "name": "network-vif-plugged", "status": "completed", "tag": "d5856f9b-e239-4613-88a7-d15a19d0765d"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:31:56.059496 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:31:56.059496 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:31:56.068085 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-7b1a8ebb-113c-40bb-b192-e9dbdf39d4cd req-98005e93-48e6-4a71-bca5-2b99b8cd6b1e service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:56.068571 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-7b1a8ebb-113c-40bb-b192-e9dbdf39d4cd req-98005e93-48e6-4a71-bca5-2b99b8cd6b1e service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:56.084341 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-7b1a8ebb-113c-40bb-b192-e9dbdf39d4cd req-98005e93-48e6-4a71-bca5-2b99b8cd6b1e service nova] Creating event network-vif-plugged:d5856f9b-e239-4613-88a7-d15a19d0765d for instance 5f23091f-27bc-4397-ad23-c7aeafafb970 on hv-cinder-82301 Dec 27 14:31:56.089659 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-7b1a8ebb-113c-40bb-b192-e9dbdf39d4cd req-98005e93-48e6-4a71-bca5-2b99b8cd6b1e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035176 Dec 27 14:31:56.090617 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 672/1315] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:31:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:31:56.821123 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d91a82da-8281-4cd4-9cff-8d587a5a3112 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:56.821936 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d91a82da-8281-4cd4-9cff-8d587a5a3112 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:56.829129 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d91a82da-8281-4cd4-9cff-8d587a5a3112 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:56.829604 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d91a82da-8281-4cd4-9cff-8d587a5a3112 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:56.830391 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d91a82da-8281-4cd4-9cff-8d587a5a3112 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:56.830812 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d91a82da-8281-4cd4-9cff-8d587a5a3112 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:56.969035 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d91a82da-8281-4cd4-9cff-8d587a5a3112 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:56.977753 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d91a82da-8281-4cd4-9cff-8d587a5a3112 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:56.979244 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d91a82da-8281-4cd4-9cff-8d587a5a3112 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:56.980430 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d91a82da-8281-4cd4-9cff-8d587a5a3112 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.162901 Dec 27 14:31:56.980980 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 644/1316] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:56 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:58.000363 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a04255aa-181d-4e4c-b043-9ce479afac49 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:58.000999 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a04255aa-181d-4e4c-b043-9ce479afac49 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:58.008445 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a04255aa-181d-4e4c-b043-9ce479afac49 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:58.008445 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a04255aa-181d-4e4c-b043-9ce479afac49 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:58.010572 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a04255aa-181d-4e4c-b043-9ce479afac49 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:58.010572 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a04255aa-181d-4e4c-b043-9ce479afac49 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:58.162091 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a04255aa-181d-4e4c-b043-9ce479afac49 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:58.171382 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a04255aa-181d-4e4c-b043-9ce479afac49 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:58.173913 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a04255aa-181d-4e4c-b043-9ce479afac49 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:58.175804 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a04255aa-181d-4e4c-b043-9ce479afac49 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1731 microversion: 2.20 time: 0.180339 Dec 27 14:31:58.176474 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 673/1317] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:57 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:31:59.194548 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-9eb66202-1b2c-42ec-bf3d-0cb8c9ea78b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:31:59.195277 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-9eb66202-1b2c-42ec-bf3d-0cb8c9ea78b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:31:59.201642 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9eb66202-1b2c-42ec-bf3d-0cb8c9ea78b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:59.202750 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9eb66202-1b2c-42ec-bf3d-0cb8c9ea78b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:59.203618 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9eb66202-1b2c-42ec-bf3d-0cb8c9ea78b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:31:59.204083 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-9eb66202-1b2c-42ec-bf3d-0cb8c9ea78b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:31:59.338698 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9eb66202-1b2c-42ec-bf3d-0cb8c9ea78b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:59.347230 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9eb66202-1b2c-42ec-bf3d-0cb8c9ea78b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:59.348750 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-9eb66202-1b2c-42ec-bf3d-0cb8c9ea78b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:31:59.349893 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-9eb66202-1b2c-42ec-bf3d-0cb8c9ea78b2 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1718 microversion: 2.20 time: 0.159237 Dec 27 14:31:59.350445 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 645/1318] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:31:59 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:33:06.677270 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-20823124-8a51-4f27-930c-cbacc861c6d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:06.679361 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-20823124-8a51-4f27-930c-cbacc861c6d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:06.689532 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20823124-8a51-4f27-930c-cbacc861c6d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:06.690220 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20823124-8a51-4f27-930c-cbacc861c6d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:06.691196 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20823124-8a51-4f27-930c-cbacc861c6d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:06.691986 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-20823124-8a51-4f27-930c-cbacc861c6d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:06.725539 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-20823124-8a51-4f27-930c-cbacc861c6d6 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052700 Dec 27 14:33:06.726328 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 674/1319] 10.222.0.37 () {60 vars in 1342 bytes} [Mon Dec 27 14:33:06 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:33:06.792778 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-93e72080-7bcd-46d5-8571-cc524b24d908 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:06.794011 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-93e72080-7bcd-46d5-8571-cc524b24d908 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:06.801953 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-93e72080-7bcd-46d5-8571-cc524b24d908 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:06.802766 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-93e72080-7bcd-46d5-8571-cc524b24d908 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:06.804465 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-93e72080-7bcd-46d5-8571-cc524b24d908 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:06.805130 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-93e72080-7bcd-46d5-8571-cc524b24d908 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:06.844158 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-93e72080-7bcd-46d5-8571-cc524b24d908 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 27 14:33:06.976333 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-93e72080-7bcd-46d5-8571-cc524b24d908 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "DELETE /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 204 len: 0 microversion: 2.20 time: 0.187319 Dec 27 14:33:06.980763 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 646/1320] 10.222.0.37 () {60 vars in 1279 bytes} [Mon Dec 27 14:33:06 2021] DELETE /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 27 14:33:06.987489 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-145f33a2-5cbb-4a83-9923-c7c312f31dbc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:06.988620 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-145f33a2-5cbb-4a83-9923-c7c312f31dbc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:06.997711 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-145f33a2-5cbb-4a83-9923-c7c312f31dbc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:06.998469 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-145f33a2-5cbb-4a83-9923-c7c312f31dbc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:06.999540 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-145f33a2-5cbb-4a83-9923-c7c312f31dbc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:07.000742 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-145f33a2-5cbb-4a83-9923-c7c312f31dbc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:07.242754 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-145f33a2-5cbb-4a83-9923-c7c312f31dbc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:07.254550 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-145f33a2-5cbb-4a83-9923-c7c312f31dbc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:07.258614 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-145f33a2-5cbb-4a83-9923-c7c312f31dbc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:07.261074 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-145f33a2-5cbb-4a83-9923-c7c312f31dbc tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1724 microversion: 2.20 time: 0.277960 Dec 27 14:33:07.261659 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 675/1321] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:33:06 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1724 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:33:08.288582 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-18cf5dcb-7967-4c94-bdcd-d932f94fbcd9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:08.289383 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-18cf5dcb-7967-4c94-bdcd-d932f94fbcd9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:08.311263 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18cf5dcb-7967-4c94-bdcd-d932f94fbcd9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:08.311734 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18cf5dcb-7967-4c94-bdcd-d932f94fbcd9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:08.316795 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18cf5dcb-7967-4c94-bdcd-d932f94fbcd9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:08.317917 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-18cf5dcb-7967-4c94-bdcd-d932f94fbcd9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:08.651885 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-18cf5dcb-7967-4c94-bdcd-d932f94fbcd9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:08.665174 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-18cf5dcb-7967-4c94-bdcd-d932f94fbcd9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:08.666768 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-18cf5dcb-7967-4c94-bdcd-d932f94fbcd9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:08.667985 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-18cf5dcb-7967-4c94-bdcd-d932f94fbcd9 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1724 microversion: 2.20 time: 0.392734 Dec 27 14:33:08.674065 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 647/1322] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:33:08 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1724 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 27 14:33:09.615277 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e59d54b0-f6bc-48c1-997b-047825b0b0e0 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Action: 'create', calling method: .version_select at 0x7f8028440550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1026104980"}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:33:09.632819 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-e59d54b0-f6bc-48c1-997b-047825b0b0e0 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Getting quotas for project a36edf49e96743a5995f7dedca7f0b38. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:33:09.637743 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-e59d54b0-f6bc-48c1-997b-047825b0b0e0 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Getting quotas for user 02377006837941538f72bfe91e6c5b88 and project a36edf49e96743a5995f7dedca7f0b38. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:33:09.690434 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-673f3102-8d8c-4da4-8d57-81a9d6c5a169 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:09.691760 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-673f3102-8d8c-4da4-8d57-81a9d6c5a169 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:09.701562 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-673f3102-8d8c-4da4-8d57-81a9d6c5a169 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:09.702337 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-673f3102-8d8c-4da4-8d57-81a9d6c5a169 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:09.703351 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-673f3102-8d8c-4da4-8d57-81a9d6c5a169 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:09.704038 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-673f3102-8d8c-4da4-8d57-81a9d6c5a169 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:09.822448 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-673f3102-8d8c-4da4-8d57-81a9d6c5a169 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:09.836130 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-673f3102-8d8c-4da4-8d57-81a9d6c5a169 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:09.841002 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-673f3102-8d8c-4da4-8d57-81a9d6c5a169 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1cfb17ae7cd742e191aa3d456e4346d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb5e638b0aa0424484c3eb48434d7e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:09.842281 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-673f3102-8d8c-4da4-8d57-81a9d6c5a169 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 200 len: 1657 microversion: 2.20 time: 0.156798 Dec 27 14:33:09.843209 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 648/1323] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:33:09 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 1657 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 27 14:33:09.858188 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-83594dcd-d2ab-48fe-94f0-28cdbe65780c req-4cfda6b3-4709-4964-9ba1-eb3bd9bd6a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f23091f-27bc-4397-ad23-c7aeafafb970", "name": "network-vif-deleted", "tag": "d5856f9b-e239-4613-88a7-d15a19d0765d"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:33:09.861405 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:33:09.861405 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:33:09.887940 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-83594dcd-d2ab-48fe-94f0-28cdbe65780c req-4cfda6b3-4709-4964-9ba1-eb3bd9bd6a0a service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:09.888730 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-83594dcd-d2ab-48fe-94f0-28cdbe65780c req-4cfda6b3-4709-4964-9ba1-eb3bd9bd6a0a service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:09.908028 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-83594dcd-d2ab-48fe-94f0-28cdbe65780c req-4cfda6b3-4709-4964-9ba1-eb3bd9bd6a0a service nova] Creating event network-vif-deleted:d5856f9b-e239-4613-88a7-d15a19d0765d for instance 5f23091f-27bc-4397-ad23-c7aeafafb970 on hv-cinder-82301 Dec 27 14:33:09.914669 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-83594dcd-d2ab-48fe-94f0-28cdbe65780c req-4cfda6b3-4709-4964-9ba1-eb3bd9bd6a0a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068167 Dec 27 14:33:09.915728 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 649/1324] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:33:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:33:10.039279 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-e59d54b0-f6bc-48c1-997b-047825b0b0e0 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Getting quotas for project a36edf49e96743a5995f7dedca7f0b38. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:33:10.043649 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-e59d54b0-f6bc-48c1-997b-047825b0b0e0 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Getting quotas for user 02377006837941538f72bfe91e6c5b88 and project a36edf49e96743a5995f7dedca7f0b38. Resources: {'key_pairs'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:33:10.059069 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e59d54b0-f6bc-48c1-997b-047825b0b0e0 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.621403 Dec 27 14:33:10.059779 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 676/1325] 10.222.0.37 () {60 vars in 1157 bytes} [Mon Dec 27 14:33:09 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:33:10.861987 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4cec33b2-9e48-43f1-8732-e17023d192cb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:10.863339 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4cec33b2-9e48-43f1-8732-e17023d192cb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:10.870606 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4cec33b2-9e48-43f1-8732-e17023d192cb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:10.871047 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4cec33b2-9e48-43f1-8732-e17023d192cb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:10.874073 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4cec33b2-9e48-43f1-8732-e17023d192cb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:10.874603 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4cec33b2-9e48-43f1-8732-e17023d192cb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:10.906002 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-4cec33b2-9e48-43f1-8732-e17023d192cb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] HTTP exception thrown: Instance 5f23091f-27bc-4397-ad23-c7aeafafb970 could not be found. Dec 27 14:33:10.906674 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4cec33b2-9e48-43f1-8732-e17023d192cb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Returning 404 to user: Instance 5f23091f-27bc-4397-ad23-c7aeafafb970 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:33:10.907737 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4cec33b2-9e48-43f1-8732-e17023d192cb tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 404 len: 111 microversion: 2.20 time: 0.050312 Dec 27 14:33:10.913252 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 650/1326] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:33:10 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 27 14:33:10.927919 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2c097b0c-6ffa-4bf3-ba0d-fe5882e07f93 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '.version_select at 0x7f802873f430>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:10.957326 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2c097b0c-6ffa-4bf3-ba0d-fe5882e07f93 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1787802580" status: 204 len: 0 microversion: 2.20 time: 0.043312 Dec 27 14:33:10.958212 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 677/1327] 10.222.0.37 () {60 vars in 1261 bytes} [Mon Dec 27 14:33:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1787802580 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 27 14:33:13.214961 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d5cfa814-df0b-41c5-91a9-801ef9b3d225 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:13.215559 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d5cfa814-df0b-41c5-91a9-801ef9b3d225 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:13.221758 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5cfa814-df0b-41c5-91a9-801ef9b3d225 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:13.222207 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5cfa814-df0b-41c5-91a9-801ef9b3d225 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:13.222990 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5cfa814-df0b-41c5-91a9-801ef9b3d225 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:13.223573 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d5cfa814-df0b-41c5-91a9-801ef9b3d225 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:13.238857 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-d5cfa814-df0b-41c5-91a9-801ef9b3d225 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] HTTP exception thrown: Instance 5f23091f-27bc-4397-ad23-c7aeafafb970 could not be found. Dec 27 14:33:13.239447 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d5cfa814-df0b-41c5-91a9-801ef9b3d225 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Returning 404 to user: Instance 5f23091f-27bc-4397-ad23-c7aeafafb970 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:33:13.240296 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d5cfa814-df0b-41c5-91a9-801ef9b3d225 tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "DELETE /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 404 len: 111 microversion: 2.20 time: 0.029104 Dec 27 14:33:13.240950 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 651/1328] 10.222.0.37 () {60 vars in 1279 bytes} [Mon Dec 27 14:33:13 2021] DELETE /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 27 14:33:13.249196 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-50f09ef1-8d8f-4ea7-94cf-845f42010f8b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:13.249804 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-50f09ef1-8d8f-4ea7-94cf-845f42010f8b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: 5f23091f-27bc-4397-ad23-c7aeafafb970] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:13.255799 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-50f09ef1-8d8f-4ea7-94cf-845f42010f8b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:13.256314 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-50f09ef1-8d8f-4ea7-94cf-845f42010f8b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:13.257240 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-50f09ef1-8d8f-4ea7-94cf-845f42010f8b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:13.257668 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-50f09ef1-8d8f-4ea7-94cf-845f42010f8b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:13.271240 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-50f09ef1-8d8f-4ea7-94cf-845f42010f8b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] HTTP exception thrown: Instance 5f23091f-27bc-4397-ad23-c7aeafafb970 could not be found. Dec 27 14:33:13.271892 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-50f09ef1-8d8f-4ea7-94cf-845f42010f8b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Returning 404 to user: Instance 5f23091f-27bc-4397-ad23-c7aeafafb970 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:33:13.273288 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-50f09ef1-8d8f-4ea7-94cf-845f42010f8b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970" status: 404 len: 111 microversion: 2.20 time: 0.028202 Dec 27 14:33:13.273848 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 678/1329] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:33:13 2021] GET /compute/v2.1/servers/5f23091f-27bc-4397-ad23-c7aeafafb970 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 27 14:33:14.402095 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3712cd62-c318-45b4-a9c0-823586214c4b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:14.403223 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3712cd62-c318-45b4-a9c0-823586214c4b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:14.412056 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3712cd62-c318-45b4-a9c0-823586214c4b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:14.412510 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3712cd62-c318-45b4-a9c0-823586214c4b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:14.413824 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3712cd62-c318-45b4-a9c0-823586214c4b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:14.414269 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3712cd62-c318-45b4-a9c0-823586214c4b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:14.428103 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-3712cd62-c318-45b4-a9c0-823586214c4b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] HTTP exception thrown: Instance aad07b94-d83b-4d44-856c-80ac2e24b8b4 could not be found. Dec 27 14:33:14.429363 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3712cd62-c318-45b4-a9c0-823586214c4b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Returning 404 to user: Instance aad07b94-d83b-4d44-856c-80ac2e24b8b4 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:33:14.430202 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3712cd62-c318-45b4-a9c0-823586214c4b tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "DELETE /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 404 len: 111 microversion: 2.20 time: 0.032218 Dec 27 14:33:14.430750 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 652/1330] 10.222.0.37 () {60 vars in 1279 bytes} [Mon Dec 27 14:33:14 2021] DELETE /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 27 14:33:14.438543 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5ab3c1c1-190a-4214-9c87-4020e4e891cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:14.439154 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5ab3c1c1-190a-4214-9c87-4020e4e891cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] [instance: aad07b94-d83b-4d44-856c-80ac2e24b8b4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:14.446169 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5ab3c1c1-190a-4214-9c87-4020e4e891cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:14.446616 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5ab3c1c1-190a-4214-9c87-4020e4e891cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:14.447414 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5ab3c1c1-190a-4214-9c87-4020e4e891cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:14.447862 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5ab3c1c1-190a-4214-9c87-4020e4e891cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:14.462341 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-5ab3c1c1-190a-4214-9c87-4020e4e891cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] HTTP exception thrown: Instance aad07b94-d83b-4d44-856c-80ac2e24b8b4 could not be found. Dec 27 14:33:14.462864 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5ab3c1c1-190a-4214-9c87-4020e4e891cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] Returning 404 to user: Instance aad07b94-d83b-4d44-856c-80ac2e24b8b4 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:33:14.463702 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5ab3c1c1-190a-4214-9c87-4020e4e891cd tempest-AttachVolumeShelveTestJSON-1465987242 tempest-AttachVolumeShelveTestJSON-1465987242-project] 10.222.0.37 "GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4" status: 404 len: 111 microversion: 2.20 time: 0.028867 Dec 27 14:33:14.464304 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 679/1331] 10.222.0.37 () {60 vars in 1276 bytes} [Mon Dec 27 14:33:14 2021] GET /compute/v2.1/servers/aad07b94-d83b-4d44-856c-80ac2e24b8b4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 27 14:33:42.092503 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4184def1-0d8f-4d8d-93ca-a82212faa06e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-532908224", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1026104980", "security_groups": [{"name": "tempest-secgroup-smoke-1262848392"}], "networks": [{"uuid": "88e95a23-a594-4f24-8889-211db842ea81"}], "block_device_mapping_v2": [{"uuid": "0556ed96-1dad-4b07-9037-1688b3e6117b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:33:42.200484 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-4184def1-0d8f-4d8d-93ca-a82212faa06e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] validate_networks() for [('88e95a23-a594-4f24-8889-211db842ea81', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 27 14:33:42.652832 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-4184def1-0d8f-4d8d-93ca-a82212faa06e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 27 14:33:42.653261 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-4184def1-0d8f-4d8d-93ca-a82212faa06e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 27 14:33:42.653740 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-4184def1-0d8f-4d8d-93ca-a82212faa06e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 27 14:33:42.654153 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-4184def1-0d8f-4d8d-93ca-a82212faa06e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 27 14:33:42.654562 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-4184def1-0d8f-4d8d-93ca-a82212faa06e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 27 14:33:42.663420 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4184def1-0d8f-4d8d-93ca-a82212faa06e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:42.663892 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4184def1-0d8f-4d8d-93ca-a82212faa06e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:42.664718 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4184def1-0d8f-4d8d-93ca-a82212faa06e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:42.665704 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4184def1-0d8f-4d8d-93ca-a82212faa06e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:42.684561 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-4184def1-0d8f-4d8d-93ca-a82212faa06e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Getting quotas for project a36edf49e96743a5995f7dedca7f0b38. Resources: {'cores', 'ram', 'instances'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:33:42.686734 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-4184def1-0d8f-4d8d-93ca-a82212faa06e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Getting quotas for user 02377006837941538f72bfe91e6c5b88 and project a36edf49e96743a5995f7dedca7f0b38. Resources: {'cores', 'ram', 'instances'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:33:42.740184 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4184def1-0d8f-4d8d-93ca-a82212faa06e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 27 14:33:42.742331 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4184def1-0d8f-4d8d-93ca-a82212faa06e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0556ed96-1dad-4b07-9037-1688b3e6117b',volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 27 14:33:42.865719 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4184def1-0d8f-4d8d-93ca-a82212faa06e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.776958 Dec 27 14:33:42.866974 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 653/1332] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Dec 27 14:33:42 2021] POST /compute/v2.1/servers => generated 406 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 27 14:33:42.877336 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-96bf0b9c-e65a-4fe3-b24a-61d4642a00d3 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:42.877974 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-96bf0b9c-e65a-4fe3-b24a-61d4642a00d3 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:42.941178 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-96bf0b9c-e65a-4fe3-b24a-61d4642a00d3 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:42.948198 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-96bf0b9c-e65a-4fe3-b24a-61d4642a00d3 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1088 microversion: 2.1 time: 0.074713 Dec 27 14:33:42.948761 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 680/1333] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:42 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1088 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:33:43.964836 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-91853752-968e-4749-b03f-28fb0e6d51e6 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:43.965612 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-91853752-968e-4749-b03f-28fb0e6d51e6 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:43.972122 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-91853752-968e-4749-b03f-28fb0e6d51e6 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:43.972681 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-91853752-968e-4749-b03f-28fb0e6d51e6 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:43.973607 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-91853752-968e-4749-b03f-28fb0e6d51e6 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:43.974144 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-91853752-968e-4749-b03f-28fb0e6d51e6 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:44.038940 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-91853752-968e-4749-b03f-28fb0e6d51e6 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:44.047768 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-91853752-968e-4749-b03f-28fb0e6d51e6 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1204 microversion: 2.1 time: 0.087584 Dec 27 14:33:44.048981 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 654/1334] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:43 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1204 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:33:44.309247 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-f9117e27-6f1a-421b-8ad1-c5107e693d64 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-694692784", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-200701949", "security_groups": [{"name": "tempest-secgroup-smoke-474312789"}], "block_device_mapping_v2": [{"uuid": "e68f5ab7-1987-4989-abd7-0d6d1e5db5bd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dfbd514e-e372-4721-aac1-a9c7fb2e81c2"}]}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:33:44.467976 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.network.neutron [None req-f9117e27-6f1a-421b-8ad1-c5107e693d64 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] validate_networks() for [('dfbd514e-e372-4721-aac1-a9c7fb2e81c2', None, None, None, None, None)] {{(pid=116105) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 27 14:33:45.065915 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-be1e5f26-982b-4c8e-bcfe-4e371c559ffd tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:45.066512 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-be1e5f26-982b-4c8e-bcfe-4e371c559ffd tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:45.074013 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-be1e5f26-982b-4c8e-bcfe-4e371c559ffd tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:45.074469 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-be1e5f26-982b-4c8e-bcfe-4e371c559ffd tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:45.075265 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-be1e5f26-982b-4c8e-bcfe-4e371c559ffd tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:45.075725 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-be1e5f26-982b-4c8e-bcfe-4e371c559ffd tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:45.195713 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-f9117e27-6f1a-421b-8ad1-c5107e693d64 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Flavor limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 27 14:33:45.196755 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-f9117e27-6f1a-421b-8ad1-c5107e693d64 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Image limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 27 14:33:45.197666 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-f9117e27-6f1a-421b-8ad1-c5107e693d64 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Flavor pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 27 14:33:45.197666 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-f9117e27-6f1a-421b-8ad1-c5107e693d64 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Image pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 27 14:33:45.198018 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-f9117e27-6f1a-421b-8ad1-c5107e693d64 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 27 14:33:45.208837 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f9117e27-6f1a-421b-8ad1-c5107e693d64 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:45.209757 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f9117e27-6f1a-421b-8ad1-c5107e693d64 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:45.211460 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f9117e27-6f1a-421b-8ad1-c5107e693d64 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:45.212915 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-f9117e27-6f1a-421b-8ad1-c5107e693d64 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:45.214684 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-be1e5f26-982b-4c8e-bcfe-4e371c559ffd tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:45.222005 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-be1e5f26-982b-4c8e-bcfe-4e371c559ffd tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1260 microversion: 2.1 time: 0.159850 Dec 27 14:33:45.222702 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 655/1335] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:45 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:33:45.236268 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-f9117e27-6f1a-421b-8ad1-c5107e693d64 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Getting quotas for project 05268adb4a234195999f6992b93b3175. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:33:45.240821 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-f9117e27-6f1a-421b-8ad1-c5107e693d64 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Getting quotas for user 529e9e9288714c6297be093f1a5e8163 and project 05268adb4a234195999f6992b93b3175. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:33:45.298144 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f9117e27-6f1a-421b-8ad1-c5107e693d64 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Going to run 1 instances... {{(pid=116105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 27 14:33:45.300322 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-f9117e27-6f1a-421b-8ad1-c5107e693d64 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e68f5ab7-1987-4989-abd7-0d6d1e5db5bd',volume_size=None,volume_type=None)] {{(pid=116105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 27 14:33:45.475952 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f9117e27-6f1a-421b-8ad1-c5107e693d64 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [893ac971-02d1-48c2-808b-5c20710aafad] AMQP server on 10.222.0.37:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 27 14:33:45.810374 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-fbf6ecfc-12e7-4ee3-a723-3478808f7f64 req-8a81e717-7e98-4d81-a881-d110c1845f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ca06c81-b73e-4443-87b2-4f6c071b4bc3", "tag": "ff0e66a2-6e25-4756-9e65-7d16cfb02fdb"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:33:45.811953 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:33:45.811953 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:33:45.818911 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-fbf6ecfc-12e7-4ee3-a723-3478808f7f64 req-8a81e717-7e98-4d81-a881-d110c1845f2d service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:45.819358 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-fbf6ecfc-12e7-4ee3-a723-3478808f7f64 req-8a81e717-7e98-4d81-a881-d110c1845f2d service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:45.831573 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-fbf6ecfc-12e7-4ee3-a723-3478808f7f64 req-8a81e717-7e98-4d81-a881-d110c1845f2d service nova] Creating event network-changed:ff0e66a2-6e25-4756-9e65-7d16cfb02fdb for instance 2ca06c81-b73e-4443-87b2-4f6c071b4bc3 on hv-cinder-82301 Dec 27 14:33:45.836553 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-fbf6ecfc-12e7-4ee3-a723-3478808f7f64 req-8a81e717-7e98-4d81-a881-d110c1845f2d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209167 Dec 27 14:33:45.838120 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 656/1336] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:33:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:33:46.240060 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fb2229cd-9d40-436a-b062-217dec0f6671 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:46.240760 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fb2229cd-9d40-436a-b062-217dec0f6671 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:46.247521 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb2229cd-9d40-436a-b062-217dec0f6671 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:46.248023 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb2229cd-9d40-436a-b062-217dec0f6671 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:46.248825 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb2229cd-9d40-436a-b062-217dec0f6671 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:46.249266 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb2229cd-9d40-436a-b062-217dec0f6671 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:46.382787 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fb2229cd-9d40-436a-b062-217dec0f6671 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:46.391034 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fb2229cd-9d40-436a-b062-217dec0f6671 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1260 microversion: 2.1 time: 0.155502 Dec 27 14:33:46.391738 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 657/1337] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:46 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:33:46.483141 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO oslo.messaging._drivers.impl_rabbit [None req-f9117e27-6f1a-421b-8ad1-c5107e693d64 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [893ac971-02d1-48c2-808b-5c20710aafad] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 38342. Dec 27 14:33:46.487331 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-f9117e27-6f1a-421b-8ad1-c5107e693d64 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.182064 Dec 27 14:33:46.488001 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 681/1338] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Dec 27 14:33:44 2021] POST /compute/v2.1/servers => generated 405 bytes in 2183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 27 14:33:46.500317 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-564eb932-80d2-40c2-bc56-1647400c37d5 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:46.500930 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-564eb932-80d2-40c2-bc56-1647400c37d5 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:46.553675 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-564eb932-80d2-40c2-bc56-1647400c37d5 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:46.560592 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-564eb932-80d2-40c2-bc56-1647400c37d5 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 200 len: 1093 microversion: 2.1 time: 0.064357 Dec 27 14:33:46.561588 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 658/1339] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:46 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:33:47.410077 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-68d50df2-092a-4c0e-8c37-d250e679c76b tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:47.411050 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-68d50df2-092a-4c0e-8c37-d250e679c76b tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:47.417653 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-68d50df2-092a-4c0e-8c37-d250e679c76b tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:47.418337 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-68d50df2-092a-4c0e-8c37-d250e679c76b tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:47.419293 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-68d50df2-092a-4c0e-8c37-d250e679c76b tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:47.420069 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-68d50df2-092a-4c0e-8c37-d250e679c76b tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:47.576474 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ec887a39-9e8e-4f54-8192-9b4255df73c2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:47.577088 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ec887a39-9e8e-4f54-8192-9b4255df73c2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:47.583441 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ec887a39-9e8e-4f54-8192-9b4255df73c2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:47.583934 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ec887a39-9e8e-4f54-8192-9b4255df73c2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:47.584731 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ec887a39-9e8e-4f54-8192-9b4255df73c2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:47.585275 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ec887a39-9e8e-4f54-8192-9b4255df73c2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:47.645768 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ec887a39-9e8e-4f54-8192-9b4255df73c2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:47.654311 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ec887a39-9e8e-4f54-8192-9b4255df73c2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 200 len: 1209 microversion: 2.1 time: 0.081506 Dec 27 14:33:47.654886 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 659/1340] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:47 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 1209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:33:47.677375 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-68d50df2-092a-4c0e-8c37-d250e679c76b tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:47.684970 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-68d50df2-092a-4c0e-8c37-d250e679c76b tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1260 microversion: 2.1 time: 0.279710 Dec 27 14:33:47.685549 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 682/1341] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:47 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1260 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:33:48.672090 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-a7afb117-5efb-4cb4-9d8a-75342d7301f1 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:48.672689 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-a7afb117-5efb-4cb4-9d8a-75342d7301f1 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:48.679212 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7afb117-5efb-4cb4-9d8a-75342d7301f1 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:48.679919 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7afb117-5efb-4cb4-9d8a-75342d7301f1 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:48.680862 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7afb117-5efb-4cb4-9d8a-75342d7301f1 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:48.681539 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-a7afb117-5efb-4cb4-9d8a-75342d7301f1 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:48.702519 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3589de34-c7df-4346-8ad4-6591322d8235 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:48.703788 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3589de34-c7df-4346-8ad4-6591322d8235 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:48.711317 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3589de34-c7df-4346-8ad4-6591322d8235 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:48.711884 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3589de34-c7df-4346-8ad4-6591322d8235 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:48.714028 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3589de34-c7df-4346-8ad4-6591322d8235 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:48.715124 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3589de34-c7df-4346-8ad4-6591322d8235 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:48.833859 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-a7afb117-5efb-4cb4-9d8a-75342d7301f1 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:48.844043 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-a7afb117-5efb-4cb4-9d8a-75342d7301f1 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 200 len: 1264 microversion: 2.1 time: 0.175566 Dec 27 14:33:48.845266 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 660/1342] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:48 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:33:48.850425 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-b081f264-b404-4f70-a9df-6b23ad320419 req-e2d72048-777e-43f5-86b8-294df6985f8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0020d108-ee79-44c1-9c9c-a9997b2faaaf", "tag": "bde15cb2-a719-4fb8-bf08-5322cd10f256"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:33:48.853012 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:33:48.853012 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:33:48.873523 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-b081f264-b404-4f70-a9df-6b23ad320419 req-e2d72048-777e-43f5-86b8-294df6985f8f service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:48.874046 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-b081f264-b404-4f70-a9df-6b23ad320419 req-e2d72048-777e-43f5-86b8-294df6985f8f service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:48.886065 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-b081f264-b404-4f70-a9df-6b23ad320419 req-e2d72048-777e-43f5-86b8-294df6985f8f service nova] Creating event network-changed:bde15cb2-a719-4fb8-bf08-5322cd10f256 for instance 0020d108-ee79-44c1-9c9c-a9997b2faaaf on hv-cinder-82301 Dec 27 14:33:48.891129 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-b081f264-b404-4f70-a9df-6b23ad320419 req-e2d72048-777e-43f5-86b8-294df6985f8f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044569 Dec 27 14:33:48.891877 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 661/1343] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:33:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:33:48.953434 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3589de34-c7df-4346-8ad4-6591322d8235 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:48.961465 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3589de34-c7df-4346-8ad4-6591322d8235 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1260 microversion: 2.1 time: 0.262830 Dec 27 14:33:48.962539 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 683/1344] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:48 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1260 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:33:49.862966 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e1491b21-ee4a-4e2d-9344-143ce15a3807 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:49.863585 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e1491b21-ee4a-4e2d-9344-143ce15a3807 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:49.870977 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1491b21-ee4a-4e2d-9344-143ce15a3807 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:49.871430 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1491b21-ee4a-4e2d-9344-143ce15a3807 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:49.872267 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1491b21-ee4a-4e2d-9344-143ce15a3807 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:49.872707 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e1491b21-ee4a-4e2d-9344-143ce15a3807 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:49.978529 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-442edc38-606f-4e81-a55c-0499506fbd02 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:49.979554 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-442edc38-606f-4e81-a55c-0499506fbd02 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:49.986048 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-442edc38-606f-4e81-a55c-0499506fbd02 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:49.986588 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-442edc38-606f-4e81-a55c-0499506fbd02 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:49.987458 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-442edc38-606f-4e81-a55c-0499506fbd02 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:49.987998 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-442edc38-606f-4e81-a55c-0499506fbd02 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:50.014647 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e1491b21-ee4a-4e2d-9344-143ce15a3807 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:50.022323 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e1491b21-ee4a-4e2d-9344-143ce15a3807 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 200 len: 1264 microversion: 2.1 time: 0.163968 Dec 27 14:33:50.022910 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 662/1345] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:49 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:33:50.173892 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-442edc38-606f-4e81-a55c-0499506fbd02 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:50.181945 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-442edc38-606f-4e81-a55c-0499506fbd02 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1260 microversion: 2.1 time: 0.207328 Dec 27 14:33:50.182511 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 684/1346] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:49 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:33:51.038228 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3e305db7-97a7-4cb4-bfa2-ec91f0615581 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:51.038951 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3e305db7-97a7-4cb4-bfa2-ec91f0615581 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:51.045970 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e305db7-97a7-4cb4-bfa2-ec91f0615581 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:51.046418 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e305db7-97a7-4cb4-bfa2-ec91f0615581 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:51.047196 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e305db7-97a7-4cb4-bfa2-ec91f0615581 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:51.047658 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3e305db7-97a7-4cb4-bfa2-ec91f0615581 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:51.181880 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3e305db7-97a7-4cb4-bfa2-ec91f0615581 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:51.189131 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3e305db7-97a7-4cb4-bfa2-ec91f0615581 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 200 len: 1264 microversion: 2.1 time: 0.154616 Dec 27 14:33:51.189695 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 663/1347] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:51 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:33:51.202370 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-08f355d4-d69b-40b3-818a-6aae8a90c6ae tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:51.202987 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-08f355d4-d69b-40b3-818a-6aae8a90c6ae tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:51.209296 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-08f355d4-d69b-40b3-818a-6aae8a90c6ae tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:51.209745 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-08f355d4-d69b-40b3-818a-6aae8a90c6ae tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:51.210533 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-08f355d4-d69b-40b3-818a-6aae8a90c6ae tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:51.210956 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-08f355d4-d69b-40b3-818a-6aae8a90c6ae tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:51.342759 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-08f355d4-d69b-40b3-818a-6aae8a90c6ae tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:51.350069 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-08f355d4-d69b-40b3-818a-6aae8a90c6ae tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1260 microversion: 2.1 time: 0.151430 Dec 27 14:33:51.350754 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 685/1348] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:51 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:33:52.206352 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e2d4ec9c-b7ec-4133-838e-642773d27cea tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:52.207011 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e2d4ec9c-b7ec-4133-838e-642773d27cea tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:52.214260 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2d4ec9c-b7ec-4133-838e-642773d27cea tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:52.214702 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2d4ec9c-b7ec-4133-838e-642773d27cea tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:52.215481 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2d4ec9c-b7ec-4133-838e-642773d27cea tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:52.215957 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2d4ec9c-b7ec-4133-838e-642773d27cea tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:52.352389 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e2d4ec9c-b7ec-4133-838e-642773d27cea tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:52.360378 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e2d4ec9c-b7ec-4133-838e-642773d27cea tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 200 len: 1264 microversion: 2.1 time: 0.157704 Dec 27 14:33:52.360947 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 664/1349] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:52 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:33:52.366015 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b1b4fd4d-3e5c-456d-8101-fe945842fc12 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:52.366623 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b1b4fd4d-3e5c-456d-8101-fe945842fc12 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:52.372995 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b1b4fd4d-3e5c-456d-8101-fe945842fc12 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:52.373442 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b1b4fd4d-3e5c-456d-8101-fe945842fc12 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:52.374222 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b1b4fd4d-3e5c-456d-8101-fe945842fc12 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:52.374661 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b1b4fd4d-3e5c-456d-8101-fe945842fc12 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:52.502171 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b1b4fd4d-3e5c-456d-8101-fe945842fc12 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:52.510209 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b1b4fd4d-3e5c-456d-8101-fe945842fc12 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1260 microversion: 2.1 time: 0.147643 Dec 27 14:33:52.510765 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 686/1350] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:52 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:33:53.377414 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-b8faa624-40c8-49c2-b70e-f7fc4e424d17 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:53.378053 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-b8faa624-40c8-49c2-b70e-f7fc4e424d17 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:53.384365 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8faa624-40c8-49c2-b70e-f7fc4e424d17 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:53.384808 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8faa624-40c8-49c2-b70e-f7fc4e424d17 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:53.385581 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8faa624-40c8-49c2-b70e-f7fc4e424d17 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:53.386013 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-b8faa624-40c8-49c2-b70e-f7fc4e424d17 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:53.513781 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-b8faa624-40c8-49c2-b70e-f7fc4e424d17 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:53.521110 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-b8faa624-40c8-49c2-b70e-f7fc4e424d17 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 200 len: 1264 microversion: 2.1 time: 0.147350 Dec 27 14:33:53.521674 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 665/1351] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:53 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:33:53.526297 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-12f60cf1-8f69-49ec-8d60-8c7e9b28ec13 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:53.527011 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-12f60cf1-8f69-49ec-8d60-8c7e9b28ec13 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:53.533615 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-12f60cf1-8f69-49ec-8d60-8c7e9b28ec13 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:53.534062 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-12f60cf1-8f69-49ec-8d60-8c7e9b28ec13 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:53.534834 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-12f60cf1-8f69-49ec-8d60-8c7e9b28ec13 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:53.535270 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-12f60cf1-8f69-49ec-8d60-8c7e9b28ec13 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:53.671657 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-12f60cf1-8f69-49ec-8d60-8c7e9b28ec13 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:53.678888 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-12f60cf1-8f69-49ec-8d60-8c7e9b28ec13 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1260 microversion: 2.1 time: 0.156233 Dec 27 14:33:53.679460 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 687/1352] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:53 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:33:54.537507 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-814ef80c-d8f7-4ed7-afec-c72cd7ada806 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:54.538113 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-814ef80c-d8f7-4ed7-afec-c72cd7ada806 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:54.545079 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-814ef80c-d8f7-4ed7-afec-c72cd7ada806 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:54.545522 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-814ef80c-d8f7-4ed7-afec-c72cd7ada806 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:54.546295 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-814ef80c-d8f7-4ed7-afec-c72cd7ada806 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:54.546727 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-814ef80c-d8f7-4ed7-afec-c72cd7ada806 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:54.679449 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-814ef80c-d8f7-4ed7-afec-c72cd7ada806 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:54.687310 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-814ef80c-d8f7-4ed7-afec-c72cd7ada806 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 200 len: 1264 microversion: 2.1 time: 0.153441 Dec 27 14:33:54.687798 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 666/1353] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:54 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:33:54.695174 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b0880065-7ab3-4eca-940c-55df55ec7c25 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:54.695817 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b0880065-7ab3-4eca-940c-55df55ec7c25 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:54.702333 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b0880065-7ab3-4eca-940c-55df55ec7c25 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:54.702784 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b0880065-7ab3-4eca-940c-55df55ec7c25 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:54.703567 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b0880065-7ab3-4eca-940c-55df55ec7c25 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:54.704034 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b0880065-7ab3-4eca-940c-55df55ec7c25 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:54.831942 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b0880065-7ab3-4eca-940c-55df55ec7c25 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:54.839157 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b0880065-7ab3-4eca-940c-55df55ec7c25 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1260 microversion: 2.1 time: 0.147631 Dec 27 14:33:54.839729 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 688/1354] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:54 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:33:55.704063 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d1c17f1b-365c-4f7b-be85-eb3fdc2265fa tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:55.704696 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d1c17f1b-365c-4f7b-be85-eb3fdc2265fa tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:55.710925 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1c17f1b-365c-4f7b-be85-eb3fdc2265fa tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:55.711365 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1c17f1b-365c-4f7b-be85-eb3fdc2265fa tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:55.712226 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1c17f1b-365c-4f7b-be85-eb3fdc2265fa tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:55.712657 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d1c17f1b-365c-4f7b-be85-eb3fdc2265fa tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:55.841762 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d1c17f1b-365c-4f7b-be85-eb3fdc2265fa tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:55.848923 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d1c17f1b-365c-4f7b-be85-eb3fdc2265fa tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 200 len: 1264 microversion: 2.1 time: 0.148505 Dec 27 14:33:55.849518 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 667/1355] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:55 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:33:55.855976 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4b9689ac-ec6b-4f20-a8c4-d58609d432fc tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:55.856582 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4b9689ac-ec6b-4f20-a8c4-d58609d432fc tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:55.862833 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4b9689ac-ec6b-4f20-a8c4-d58609d432fc tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:55.863273 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4b9689ac-ec6b-4f20-a8c4-d58609d432fc tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:55.864089 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4b9689ac-ec6b-4f20-a8c4-d58609d432fc tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:55.864520 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4b9689ac-ec6b-4f20-a8c4-d58609d432fc tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:55.999565 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4b9689ac-ec6b-4f20-a8c4-d58609d432fc tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:56.006992 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4b9689ac-ec6b-4f20-a8c4-d58609d432fc tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1260 microversion: 2.1 time: 0.155213 Dec 27 14:33:56.007574 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 689/1356] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:55 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:33:56.866318 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0e2f5d80-c74a-4be8-a5de-afa4adea9998 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:56.866923 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0e2f5d80-c74a-4be8-a5de-afa4adea9998 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:56.874000 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e2f5d80-c74a-4be8-a5de-afa4adea9998 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:56.874474 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e2f5d80-c74a-4be8-a5de-afa4adea9998 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:56.875247 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e2f5d80-c74a-4be8-a5de-afa4adea9998 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:56.875675 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0e2f5d80-c74a-4be8-a5de-afa4adea9998 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:57.008735 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0e2f5d80-c74a-4be8-a5de-afa4adea9998 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:57.021842 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0e2f5d80-c74a-4be8-a5de-afa4adea9998 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 200 len: 1264 microversion: 2.1 time: 0.159165 Dec 27 14:33:57.022421 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 668/1357] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:56 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:33:57.025136 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ee1355f0-e1da-47cc-bbec-b0dc33a96787 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:57.029959 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ee1355f0-e1da-47cc-bbec-b0dc33a96787 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:57.040974 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ee1355f0-e1da-47cc-bbec-b0dc33a96787 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:57.041435 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ee1355f0-e1da-47cc-bbec-b0dc33a96787 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:57.042226 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ee1355f0-e1da-47cc-bbec-b0dc33a96787 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:57.043660 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ee1355f0-e1da-47cc-bbec-b0dc33a96787 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:57.178764 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ee1355f0-e1da-47cc-bbec-b0dc33a96787 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:57.186680 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ee1355f0-e1da-47cc-bbec-b0dc33a96787 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1260 microversion: 2.1 time: 0.166706 Dec 27 14:33:57.187246 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 690/1358] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:57 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:33:58.039109 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1b8cee8b-b132-49fc-9b01-c818ae3f3acc tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:58.039730 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1b8cee8b-b132-49fc-9b01-c818ae3f3acc tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:58.046053 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b8cee8b-b132-49fc-9b01-c818ae3f3acc tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:58.046501 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b8cee8b-b132-49fc-9b01-c818ae3f3acc tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:58.047282 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b8cee8b-b132-49fc-9b01-c818ae3f3acc tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:58.047719 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1b8cee8b-b132-49fc-9b01-c818ae3f3acc tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:58.179139 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1b8cee8b-b132-49fc-9b01-c818ae3f3acc tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:58.187105 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1b8cee8b-b132-49fc-9b01-c818ae3f3acc tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 200 len: 1264 microversion: 2.1 time: 0.151581 Dec 27 14:33:58.187679 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 669/1359] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:58 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:33:58.202396 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b40ec62f-5170-4c5d-af0b-167772a355aa tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:58.203214 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b40ec62f-5170-4c5d-af0b-167772a355aa tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:58.209398 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b40ec62f-5170-4c5d-af0b-167772a355aa tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:58.209905 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b40ec62f-5170-4c5d-af0b-167772a355aa tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:58.210624 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b40ec62f-5170-4c5d-af0b-167772a355aa tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:58.211081 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b40ec62f-5170-4c5d-af0b-167772a355aa tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:58.346844 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b40ec62f-5170-4c5d-af0b-167772a355aa tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:58.354705 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b40ec62f-5170-4c5d-af0b-167772a355aa tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1260 microversion: 2.1 time: 0.155971 Dec 27 14:33:58.355263 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 691/1360] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:58 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:33:59.203767 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ba1f5449-84db-436e-a3e3-b9057e3d4bf8 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:59.204401 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ba1f5449-84db-436e-a3e3-b9057e3d4bf8 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:59.210650 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ba1f5449-84db-436e-a3e3-b9057e3d4bf8 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:59.211097 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ba1f5449-84db-436e-a3e3-b9057e3d4bf8 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:59.212171 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ba1f5449-84db-436e-a3e3-b9057e3d4bf8 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:59.212622 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ba1f5449-84db-436e-a3e3-b9057e3d4bf8 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:59.351172 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-ba1f5449-84db-436e-a3e3-b9057e3d4bf8 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:59.359084 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ba1f5449-84db-436e-a3e3-b9057e3d4bf8 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 200 len: 1264 microversion: 2.1 time: 0.158964 Dec 27 14:33:59.359647 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 670/1361] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:59 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:33:59.370858 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-718976c6-b8a6-4add-82c9-c44165024345 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:33:59.371502 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-718976c6-b8a6-4add-82c9-c44165024345 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:33:59.377737 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-718976c6-b8a6-4add-82c9-c44165024345 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:59.378182 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-718976c6-b8a6-4add-82c9-c44165024345 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:59.378956 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-718976c6-b8a6-4add-82c9-c44165024345 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:33:59.379389 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-718976c6-b8a6-4add-82c9-c44165024345 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:33:59.525706 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-718976c6-b8a6-4add-82c9-c44165024345 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:33:59.535422 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-718976c6-b8a6-4add-82c9-c44165024345 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1260 microversion: 2.1 time: 0.168935 Dec 27 14:33:59.536033 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 692/1362] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:33:59 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:00.376013 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-0cd1760f-0c93-4d73-bef9-e960a4b7c25a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:00.376554 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-0cd1760f-0c93-4d73-bef9-e960a4b7c25a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:00.382817 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0cd1760f-0c93-4d73-bef9-e960a4b7c25a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:00.383269 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0cd1760f-0c93-4d73-bef9-e960a4b7c25a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:00.384790 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0cd1760f-0c93-4d73-bef9-e960a4b7c25a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:00.385232 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-0cd1760f-0c93-4d73-bef9-e960a4b7c25a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:00.516360 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-0cd1760f-0c93-4d73-bef9-e960a4b7c25a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:00.523587 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-0cd1760f-0c93-4d73-bef9-e960a4b7c25a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 200 len: 1264 microversion: 2.1 time: 0.151487 Dec 27 14:34:00.524694 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 671/1363] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:00 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:00.555826 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a6432d3a-ce0f-405e-97df-22a1d6ed00fd tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:00.556510 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a6432d3a-ce0f-405e-97df-22a1d6ed00fd tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:00.562293 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a6432d3a-ce0f-405e-97df-22a1d6ed00fd tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:00.562736 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a6432d3a-ce0f-405e-97df-22a1d6ed00fd tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:00.563508 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a6432d3a-ce0f-405e-97df-22a1d6ed00fd tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:00.564011 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a6432d3a-ce0f-405e-97df-22a1d6ed00fd tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:00.691531 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a6432d3a-ce0f-405e-97df-22a1d6ed00fd tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:00.699481 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a6432d3a-ce0f-405e-97df-22a1d6ed00fd tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1260 microversion: 2.1 time: 0.147702 Dec 27 14:34:00.700087 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 693/1364] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:00 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:01.541273 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-669998d6-b2b2-43f5-acc6-b9afc25b11fa tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:01.541919 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-669998d6-b2b2-43f5-acc6-b9afc25b11fa tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:01.548259 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-669998d6-b2b2-43f5-acc6-b9afc25b11fa tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:01.548710 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-669998d6-b2b2-43f5-acc6-b9afc25b11fa tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:01.549493 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-669998d6-b2b2-43f5-acc6-b9afc25b11fa tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:01.549930 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-669998d6-b2b2-43f5-acc6-b9afc25b11fa tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:01.678051 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-669998d6-b2b2-43f5-acc6-b9afc25b11fa tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:01.685768 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-669998d6-b2b2-43f5-acc6-b9afc25b11fa tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 200 len: 1264 microversion: 2.1 time: 0.148743 Dec 27 14:34:01.686338 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 672/1365] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:01 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:34:01.714905 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-df9293cf-7843-437b-b717-2a271f26f8dc tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:01.715511 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-df9293cf-7843-437b-b717-2a271f26f8dc tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:01.721764 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-df9293cf-7843-437b-b717-2a271f26f8dc tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:01.722216 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-df9293cf-7843-437b-b717-2a271f26f8dc tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:01.722985 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-df9293cf-7843-437b-b717-2a271f26f8dc tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:01.723414 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-df9293cf-7843-437b-b717-2a271f26f8dc tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:01.855809 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-df9293cf-7843-437b-b717-2a271f26f8dc tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:01.862953 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-df9293cf-7843-437b-b717-2a271f26f8dc tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1260 microversion: 2.1 time: 0.151840 Dec 27 14:34:01.863525 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 694/1366] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:01 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:02.702902 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-54e599a1-906e-4fcf-8b43-ea4dce8e8021 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:02.703521 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-54e599a1-906e-4fcf-8b43-ea4dce8e8021 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:02.709911 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54e599a1-906e-4fcf-8b43-ea4dce8e8021 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:02.710365 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54e599a1-906e-4fcf-8b43-ea4dce8e8021 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:02.711155 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54e599a1-906e-4fcf-8b43-ea4dce8e8021 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:02.711605 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-54e599a1-906e-4fcf-8b43-ea4dce8e8021 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:02.842208 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-54e599a1-906e-4fcf-8b43-ea4dce8e8021 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:02.849402 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-54e599a1-906e-4fcf-8b43-ea4dce8e8021 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 200 len: 1264 microversion: 2.1 time: 0.150191 Dec 27 14:34:02.849979 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 673/1367] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:02 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:02.878124 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-0ee8128d-1da8-4e0f-b134-bfd621ebfe30 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:02.878739 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-0ee8128d-1da8-4e0f-b134-bfd621ebfe30 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:02.885665 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0ee8128d-1da8-4e0f-b134-bfd621ebfe30 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:02.886118 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0ee8128d-1da8-4e0f-b134-bfd621ebfe30 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:02.886910 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0ee8128d-1da8-4e0f-b134-bfd621ebfe30 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:02.887349 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-0ee8128d-1da8-4e0f-b134-bfd621ebfe30 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:03.020334 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-0ee8128d-1da8-4e0f-b134-bfd621ebfe30 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:03.027868 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-0ee8128d-1da8-4e0f-b134-bfd621ebfe30 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1260 microversion: 2.1 time: 0.153287 Dec 27 14:34:03.028450 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 695/1368] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:02 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:03.259898 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-d3580d33-a675-41b5-a195-29b219f7507e req-ccbca48a-8866-443b-a9c0-96f23c5f23d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca06c81-b73e-4443-87b2-4f6c071b4bc3", "name": "network-vif-plugged", "status": "completed", "tag": "ff0e66a2-6e25-4756-9e65-7d16cfb02fdb"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:34:03.267108 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:34:03.267108 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:34:03.274286 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-d3580d33-a675-41b5-a195-29b219f7507e req-ccbca48a-8866-443b-a9c0-96f23c5f23d5 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:03.274731 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-d3580d33-a675-41b5-a195-29b219f7507e req-ccbca48a-8866-443b-a9c0-96f23c5f23d5 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:03.285998 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-d3580d33-a675-41b5-a195-29b219f7507e req-ccbca48a-8866-443b-a9c0-96f23c5f23d5 service nova] Creating event network-vif-plugged:ff0e66a2-6e25-4756-9e65-7d16cfb02fdb for instance 2ca06c81-b73e-4443-87b2-4f6c071b4bc3 on hv-cinder-82301 Dec 27 14:34:03.296052 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-d3580d33-a675-41b5-a195-29b219f7507e req-ccbca48a-8866-443b-a9c0-96f23c5f23d5 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106979 Dec 27 14:34:03.296912 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 674/1369] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:34:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:34:03.866561 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-de46cf3e-3a99-4066-a8b1-e9eb3db1dafd tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:03.867087 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-de46cf3e-3a99-4066-a8b1-e9eb3db1dafd tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:03.873314 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-de46cf3e-3a99-4066-a8b1-e9eb3db1dafd tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:03.873755 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-de46cf3e-3a99-4066-a8b1-e9eb3db1dafd tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:03.874665 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-de46cf3e-3a99-4066-a8b1-e9eb3db1dafd tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:03.875097 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-de46cf3e-3a99-4066-a8b1-e9eb3db1dafd tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:04.012168 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-de46cf3e-3a99-4066-a8b1-e9eb3db1dafd tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:04.019362 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-de46cf3e-3a99-4066-a8b1-e9eb3db1dafd tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 200 len: 1264 microversion: 2.1 time: 0.156692 Dec 27 14:34:04.019948 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 696/1370] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:03 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:04.045707 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-98940d9a-669b-465c-9a4a-06bd04166c81 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:04.046411 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-98940d9a-669b-465c-9a4a-06bd04166c81 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:04.052529 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-98940d9a-669b-465c-9a4a-06bd04166c81 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:04.052988 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-98940d9a-669b-465c-9a4a-06bd04166c81 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:04.053788 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-98940d9a-669b-465c-9a4a-06bd04166c81 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:04.054227 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-98940d9a-669b-465c-9a4a-06bd04166c81 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:04.197956 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-98940d9a-669b-465c-9a4a-06bd04166c81 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:04.206306 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-98940d9a-669b-465c-9a4a-06bd04166c81 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1260 microversion: 2.1 time: 0.164974 Dec 27 14:34:04.206876 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 675/1371] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:04 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:34:05.037564 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-aa9c2284-901d-4426-b52c-0e9a3ad66ce4 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:05.038509 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-aa9c2284-901d-4426-b52c-0e9a3ad66ce4 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:05.045887 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa9c2284-901d-4426-b52c-0e9a3ad66ce4 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:05.046686 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa9c2284-901d-4426-b52c-0e9a3ad66ce4 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:05.047592 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa9c2284-901d-4426-b52c-0e9a3ad66ce4 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:05.048152 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa9c2284-901d-4426-b52c-0e9a3ad66ce4 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:05.190899 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-aa9c2284-901d-4426-b52c-0e9a3ad66ce4 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:05.198753 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-aa9c2284-901d-4426-b52c-0e9a3ad66ce4 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 200 len: 1264 microversion: 2.1 time: 0.165563 Dec 27 14:34:05.199379 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 697/1372] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:05 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:05.223538 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fb4cc8dc-5142-4faf-9f5a-ba77a8b2385d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:05.224583 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fb4cc8dc-5142-4faf-9f5a-ba77a8b2385d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:05.231528 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb4cc8dc-5142-4faf-9f5a-ba77a8b2385d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:05.232210 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb4cc8dc-5142-4faf-9f5a-ba77a8b2385d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:05.233171 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb4cc8dc-5142-4faf-9f5a-ba77a8b2385d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:05.233617 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fb4cc8dc-5142-4faf-9f5a-ba77a8b2385d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:05.311299 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-ec21032c-f5ad-4ad5-83aa-4c8e1124108a req-25da14e2-63c4-41ec-9e72-a013e03d3fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0020d108-ee79-44c1-9c9c-a9997b2faaaf", "name": "network-vif-plugged", "status": "completed", "tag": "bde15cb2-a719-4fb8-bf08-5322cd10f256"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:34:05.312922 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:34:05.312922 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:34:05.321843 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-ec21032c-f5ad-4ad5-83aa-4c8e1124108a req-25da14e2-63c4-41ec-9e72-a013e03d3fe2 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:05.321981 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-ec21032c-f5ad-4ad5-83aa-4c8e1124108a req-25da14e2-63c4-41ec-9e72-a013e03d3fe2 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:05.333456 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-ec21032c-f5ad-4ad5-83aa-4c8e1124108a req-25da14e2-63c4-41ec-9e72-a013e03d3fe2 service nova] Creating event network-vif-plugged:bde15cb2-a719-4fb8-bf08-5322cd10f256 for instance 0020d108-ee79-44c1-9c9c-a9997b2faaaf on hv-cinder-82301 Dec 27 14:34:05.338730 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-ec21032c-f5ad-4ad5-83aa-4c8e1124108a req-25da14e2-63c4-41ec-9e72-a013e03d3fe2 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030965 Dec 27 14:34:05.339322 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 698/1373] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:34:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:34:05.383761 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fb4cc8dc-5142-4faf-9f5a-ba77a8b2385d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:05.391388 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fb4cc8dc-5142-4faf-9f5a-ba77a8b2385d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1445 microversion: 2.1 time: 0.171472 Dec 27 14:34:05.391989 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 676/1374] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:05 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1445 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:05.407884 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5203b7c8-4bc5-417d-bc61-eca38323bbc1 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:05.408584 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5203b7c8-4bc5-417d-bc61-eca38323bbc1 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:05.415318 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5203b7c8-4bc5-417d-bc61-eca38323bbc1 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:05.415897 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5203b7c8-4bc5-417d-bc61-eca38323bbc1 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:05.416676 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5203b7c8-4bc5-417d-bc61-eca38323bbc1 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:05.417115 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-5203b7c8-4bc5-417d-bc61-eca38323bbc1 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:05.588133 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5203b7c8-4bc5-417d-bc61-eca38323bbc1 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:05.595689 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5203b7c8-4bc5-417d-bc61-eca38323bbc1 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1445 microversion: 2.1 time: 0.192035 Dec 27 14:34:05.596307 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 699/1375] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:05 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1445 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:06.216121 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e4f14825-7202-4227-9934-b8769eb3b0f2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:06.216988 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e4f14825-7202-4227-9934-b8769eb3b0f2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:06.223107 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e4f14825-7202-4227-9934-b8769eb3b0f2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:06.223765 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e4f14825-7202-4227-9934-b8769eb3b0f2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:06.224659 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e4f14825-7202-4227-9934-b8769eb3b0f2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:06.225165 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e4f14825-7202-4227-9934-b8769eb3b0f2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:06.480857 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e4f14825-7202-4227-9934-b8769eb3b0f2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:06.488253 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e4f14825-7202-4227-9934-b8769eb3b0f2 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 200 len: 1264 microversion: 2.1 time: 0.276247 Dec 27 14:34:06.488831 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 677/1376] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:06 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 1264 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:07.504871 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e96a83d3-6274-473d-af82-ef23b2de866a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:07.505480 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e96a83d3-6274-473d-af82-ef23b2de866a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:07.512568 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e96a83d3-6274-473d-af82-ef23b2de866a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:07.513018 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e96a83d3-6274-473d-af82-ef23b2de866a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:07.513953 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e96a83d3-6274-473d-af82-ef23b2de866a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:07.514391 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e96a83d3-6274-473d-af82-ef23b2de866a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:07.663010 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e96a83d3-6274-473d-af82-ef23b2de866a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:07.671224 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e96a83d3-6274-473d-af82-ef23b2de866a tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 200 len: 1451 microversion: 2.1 time: 0.170016 Dec 27 14:34:07.671925 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 700/1377] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:07 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 1451 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:07.687357 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-00bfeffc-3a51-4e2f-b391-33efe8a3ccb3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:07.688273 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-00bfeffc-3a51-4e2f-b391-33efe8a3ccb3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:07.694560 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-00bfeffc-3a51-4e2f-b391-33efe8a3ccb3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:07.695018 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-00bfeffc-3a51-4e2f-b391-33efe8a3ccb3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:07.696419 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-00bfeffc-3a51-4e2f-b391-33efe8a3ccb3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:07.697890 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-00bfeffc-3a51-4e2f-b391-33efe8a3ccb3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:07.708789 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-6f914a48-7777-4ea9-b65b-e17472b5fb39 req-db3c32b8-ba00-42d2-8377-3787fc47ad75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ca06c81-b73e-4443-87b2-4f6c071b4bc3", "tag": "ff0e66a2-6e25-4756-9e65-7d16cfb02fdb"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:34:07.710778 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:34:07.710778 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:34:07.719070 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-6f914a48-7777-4ea9-b65b-e17472b5fb39 req-db3c32b8-ba00-42d2-8377-3787fc47ad75 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:07.720076 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-6f914a48-7777-4ea9-b65b-e17472b5fb39 req-db3c32b8-ba00-42d2-8377-3787fc47ad75 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:07.731807 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-6f914a48-7777-4ea9-b65b-e17472b5fb39 req-db3c32b8-ba00-42d2-8377-3787fc47ad75 service nova] Creating event network-changed:ff0e66a2-6e25-4756-9e65-7d16cfb02fdb for instance 2ca06c81-b73e-4443-87b2-4f6c071b4bc3 on hv-cinder-82301 Dec 27 14:34:07.737393 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-6f914a48-7777-4ea9-b65b-e17472b5fb39 req-db3c32b8-ba00-42d2-8377-3787fc47ad75 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092029 Dec 27 14:34:07.738418 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 678/1378] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:34:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:34:07.888408 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-00bfeffc-3a51-4e2f-b391-33efe8a3ccb3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:07.898990 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-00bfeffc-3a51-4e2f-b391-33efe8a3ccb3 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 200 len: 1451 microversion: 2.1 time: 0.214575 Dec 27 14:34:07.911155 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 701/1379] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:07 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 1451 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:34:09.752972 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-b93b06ee-eae3-428b-ad4b-e9e4de90506b req-38b261eb-94ff-4c47-bc62-62b28eb268e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0020d108-ee79-44c1-9c9c-a9997b2faaaf", "tag": "bde15cb2-a719-4fb8-bf08-5322cd10f256"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:34:09.754524 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:34:09.754524 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:34:09.762781 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-b93b06ee-eae3-428b-ad4b-e9e4de90506b req-38b261eb-94ff-4c47-bc62-62b28eb268e9 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:09.763341 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-b93b06ee-eae3-428b-ad4b-e9e4de90506b req-38b261eb-94ff-4c47-bc62-62b28eb268e9 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:09.774168 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-b93b06ee-eae3-428b-ad4b-e9e4de90506b req-38b261eb-94ff-4c47-bc62-62b28eb268e9 service nova] Creating event network-changed:bde15cb2-a719-4fb8-bf08-5322cd10f256 for instance 0020d108-ee79-44c1-9c9c-a9997b2faaaf on hv-cinder-82301 Dec 27 14:34:09.779425 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-b93b06ee-eae3-428b-ad4b-e9e4de90506b req-38b261eb-94ff-4c47-bc62-62b28eb268e9 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030454 Dec 27 14:34:09.780205 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 679/1380] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:34:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:34:17.021496 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 27 14:34:17.022117 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: Mon Dec 27 14:34:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 27 14:34:26.776287 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e472f28e-25b4-4241-8515-9cda74891581 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1666804754", "imageRef": "c8bd383f-96c5-4e2b-aaa5-fabd68b307f6", "flavorRef": "452", "networks": [{"uuid": "93681472-bb9b-4652-b7a4-ba722737b660"}]}} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:34:26.828508 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.network.neutron [None req-e472f28e-25b4-4241-8515-9cda74891581 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] validate_networks() for [('93681472-bb9b-4652-b7a4-ba722737b660', None, None, None, None, None)] {{(pid=116105) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 27 14:34:27.165479 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-e472f28e-25b4-4241-8515-9cda74891581 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Flavor limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 27 14:34:27.165901 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-e472f28e-25b4-4241-8515-9cda74891581 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Image limits 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 27 14:34:27.166375 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-e472f28e-25b4-4241-8515-9cda74891581 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Flavor pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 27 14:34:27.166788 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-e472f28e-25b4-4241-8515-9cda74891581 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Image pref 0:0:0 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 27 14:34:27.167198 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.virt.hardware [None req-e472f28e-25b4-4241-8515-9cda74891581 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116105) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 27 14:34:27.175794 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e472f28e-25b4-4241-8515-9cda74891581 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:27.176268 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e472f28e-25b4-4241-8515-9cda74891581 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:27.177079 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e472f28e-25b4-4241-8515-9cda74891581 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:27.177519 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e472f28e-25b4-4241-8515-9cda74891581 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:27.194133 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-e472f28e-25b4-4241-8515-9cda74891581 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Getting quotas for project b306b1ad096c487198d782c3c57e0309. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:34:27.198329 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.quota [None req-e472f28e-25b4-4241-8515-9cda74891581 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Getting quotas for user ad4fef8fff714ae9880cf4054b940607 and project b306b1ad096c487198d782c3c57e0309. Resources: {'cores', 'ram', 'instances'} {{(pid=116105) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:34:27.209147 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e472f28e-25b4-4241-8515-9cda74891581 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Going to run 1 instances... {{(pid=116105) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 27 14:34:27.211371 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e472f28e-25b4-4241-8515-9cda74891581 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 21e9aa1f-ff09-4aac-b5a3-e1083e4b142c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c8bd383f-96c5-4e2b-aaa5-fabd68b307f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116105) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 27 14:34:27.255312 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e472f28e-25b4-4241-8515-9cda74891581 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.482688 Dec 27 14:34:27.255992 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 702/1381] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Dec 27 14:34:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 27 14:34:27.266947 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bdadf9e8-5d33-418f-80d9-3eaec56f6ae8 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:27.267733 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bdadf9e8-5d33-418f-80d9-3eaec56f6ae8 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 21e9aa1f-ff09-4aac-b5a3-e1083e4b142c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:27.320255 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bdadf9e8-5d33-418f-80d9-3eaec56f6ae8 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:27.326947 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bdadf9e8-5d33-418f-80d9-3eaec56f6ae8 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c" status: 200 len: 1214 microversion: 2.1 time: 0.064516 Dec 27 14:34:27.327505 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 680/1382] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:27 2021] GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:28.343934 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b7f13fae-22bf-4d85-9237-95276f54093d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:28.344842 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b7f13fae-22bf-4d85-9237-95276f54093d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 21e9aa1f-ff09-4aac-b5a3-e1083e4b142c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:28.350996 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b7f13fae-22bf-4d85-9237-95276f54093d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:28.351584 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b7f13fae-22bf-4d85-9237-95276f54093d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:28.353827 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b7f13fae-22bf-4d85-9237-95276f54093d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:28.353827 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b7f13fae-22bf-4d85-9237-95276f54093d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:28.420488 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b7f13fae-22bf-4d85-9237-95276f54093d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:28.427962 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b7f13fae-22bf-4d85-9237-95276f54093d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c" status: 200 len: 1272 microversion: 2.1 time: 0.088377 Dec 27 14:34:28.428798 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 703/1383] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:28 2021] GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c => generated 1272 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:29.444869 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f7b14a67-7b9a-4fbf-9b6c-87597559d261 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:29.445752 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f7b14a67-7b9a-4fbf-9b6c-87597559d261 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 21e9aa1f-ff09-4aac-b5a3-e1083e4b142c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:29.452933 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f7b14a67-7b9a-4fbf-9b6c-87597559d261 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:29.453371 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f7b14a67-7b9a-4fbf-9b6c-87597559d261 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:29.454159 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f7b14a67-7b9a-4fbf-9b6c-87597559d261 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:29.454590 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f7b14a67-7b9a-4fbf-9b6c-87597559d261 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:29.466112 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-286e1068-1c5d-4c98-90b3-2cd09c329210 req-19531c34-ea03-40e6-8b1b-7411b6a773db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21e9aa1f-ff09-4aac-b5a3-e1083e4b142c", "tag": "2397603d-1667-416f-9685-26fb43eae1a4"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:34:29.469776 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:34:29.469776 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:34:29.480445 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-286e1068-1c5d-4c98-90b3-2cd09c329210 req-19531c34-ea03-40e6-8b1b-7411b6a773db service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:29.481892 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-286e1068-1c5d-4c98-90b3-2cd09c329210 req-19531c34-ea03-40e6-8b1b-7411b6a773db service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:29.497065 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-286e1068-1c5d-4c98-90b3-2cd09c329210 req-19531c34-ea03-40e6-8b1b-7411b6a773db service nova] Creating event network-changed:2397603d-1667-416f-9685-26fb43eae1a4 for instance 21e9aa1f-ff09-4aac-b5a3-e1083e4b142c on hv-cinder-82301 Dec 27 14:34:29.502248 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-286e1068-1c5d-4c98-90b3-2cd09c329210 req-19531c34-ea03-40e6-8b1b-7411b6a773db service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041473 Dec 27 14:34:29.503166 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 704/1384] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:34:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:34:29.598130 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f7b14a67-7b9a-4fbf-9b6c-87597559d261 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:29.606050 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f7b14a67-7b9a-4fbf-9b6c-87597559d261 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c" status: 200 len: 1314 microversion: 2.1 time: 0.164964 Dec 27 14:34:29.606617 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 681/1385] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:29 2021] GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:30.624094 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-67e1aa96-c888-4710-820b-1cc7b2ee478a tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:30.624703 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-67e1aa96-c888-4710-820b-1cc7b2ee478a tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 21e9aa1f-ff09-4aac-b5a3-e1083e4b142c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:30.630742 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-67e1aa96-c888-4710-820b-1cc7b2ee478a tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:30.631183 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-67e1aa96-c888-4710-820b-1cc7b2ee478a tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:30.631979 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-67e1aa96-c888-4710-820b-1cc7b2ee478a tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:30.632412 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-67e1aa96-c888-4710-820b-1cc7b2ee478a tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:30.765399 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-67e1aa96-c888-4710-820b-1cc7b2ee478a tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:30.772644 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-67e1aa96-c888-4710-820b-1cc7b2ee478a tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c" status: 200 len: 1314 microversion: 2.1 time: 0.153244 Dec 27 14:34:30.773213 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 705/1386] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:30 2021] GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:31.790374 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-41338b02-35d3-4002-80e5-215dae42b477 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:31.790981 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-41338b02-35d3-4002-80e5-215dae42b477 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 21e9aa1f-ff09-4aac-b5a3-e1083e4b142c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:31.797186 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41338b02-35d3-4002-80e5-215dae42b477 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:31.797630 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41338b02-35d3-4002-80e5-215dae42b477 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:31.798415 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41338b02-35d3-4002-80e5-215dae42b477 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:31.798844 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41338b02-35d3-4002-80e5-215dae42b477 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:31.931855 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-41338b02-35d3-4002-80e5-215dae42b477 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:31.939055 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-41338b02-35d3-4002-80e5-215dae42b477 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c" status: 200 len: 1314 microversion: 2.1 time: 0.152930 Dec 27 14:34:31.939610 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 682/1387] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:31 2021] GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:32.955501 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-089f804b-b41c-49bc-9b9a-4ce86f17d6a6 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:32.956152 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-089f804b-b41c-49bc-9b9a-4ce86f17d6a6 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 21e9aa1f-ff09-4aac-b5a3-e1083e4b142c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:32.962645 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-089f804b-b41c-49bc-9b9a-4ce86f17d6a6 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:32.963095 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-089f804b-b41c-49bc-9b9a-4ce86f17d6a6 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:32.963907 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-089f804b-b41c-49bc-9b9a-4ce86f17d6a6 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:32.964351 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-089f804b-b41c-49bc-9b9a-4ce86f17d6a6 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:33.093634 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-089f804b-b41c-49bc-9b9a-4ce86f17d6a6 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:33.100831 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-089f804b-b41c-49bc-9b9a-4ce86f17d6a6 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c" status: 200 len: 1314 microversion: 2.1 time: 0.148964 Dec 27 14:34:33.101410 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 706/1388] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:32 2021] GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:34.117898 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1c113551-61b7-4f1f-ab70-291a88ae27f1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:34.118512 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1c113551-61b7-4f1f-ab70-291a88ae27f1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 21e9aa1f-ff09-4aac-b5a3-e1083e4b142c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:34.124784 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c113551-61b7-4f1f-ab70-291a88ae27f1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:34.125229 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c113551-61b7-4f1f-ab70-291a88ae27f1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:34.126012 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c113551-61b7-4f1f-ab70-291a88ae27f1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:34.126440 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1c113551-61b7-4f1f-ab70-291a88ae27f1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:34.252934 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1c113551-61b7-4f1f-ab70-291a88ae27f1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:34.260099 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1c113551-61b7-4f1f-ab70-291a88ae27f1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c" status: 200 len: 1314 microversion: 2.1 time: 0.146010 Dec 27 14:34:34.260662 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 683/1389] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:34 2021] GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:35.276570 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-762332b3-6bf5-4014-a158-144a104b5465 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:35.277200 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-762332b3-6bf5-4014-a158-144a104b5465 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 21e9aa1f-ff09-4aac-b5a3-e1083e4b142c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:35.284200 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-762332b3-6bf5-4014-a158-144a104b5465 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:35.284645 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-762332b3-6bf5-4014-a158-144a104b5465 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:35.285430 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-762332b3-6bf5-4014-a158-144a104b5465 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:35.285858 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-762332b3-6bf5-4014-a158-144a104b5465 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:35.339456 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-a2097a62-1b8d-4a74-a86b-3ee972d62b5b req-1e96cff5-0757-4a79-b42f-957152f91fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e9aa1f-ff09-4aac-b5a3-e1083e4b142c", "name": "network-vif-plugged", "status": "completed", "tag": "2397603d-1667-416f-9685-26fb43eae1a4"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:34:35.341076 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:34:35.341076 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:34:35.349217 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-a2097a62-1b8d-4a74-a86b-3ee972d62b5b req-1e96cff5-0757-4a79-b42f-957152f91fe3 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:35.349736 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-a2097a62-1b8d-4a74-a86b-3ee972d62b5b req-1e96cff5-0757-4a79-b42f-957152f91fe3 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:35.365208 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-a2097a62-1b8d-4a74-a86b-3ee972d62b5b req-1e96cff5-0757-4a79-b42f-957152f91fe3 service nova] Creating event network-vif-plugged:2397603d-1667-416f-9685-26fb43eae1a4 for instance 21e9aa1f-ff09-4aac-b5a3-e1083e4b142c on hv-cinder-82301 Dec 27 14:34:35.371883 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-a2097a62-1b8d-4a74-a86b-3ee972d62b5b req-1e96cff5-0757-4a79-b42f-957152f91fe3 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036317 Dec 27 14:34:35.373111 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 684/1390] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:34:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:34:35.433009 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-762332b3-6bf5-4014-a158-144a104b5465 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:35.441022 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-762332b3-6bf5-4014-a158-144a104b5465 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c" status: 200 len: 1314 microversion: 2.1 time: 0.168130 Dec 27 14:34:35.441721 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 707/1391] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:35 2021] GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:36.457558 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-8e1044d5-715b-4310-9f0e-1131bdbe097a tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:36.458260 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-8e1044d5-715b-4310-9f0e-1131bdbe097a tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 21e9aa1f-ff09-4aac-b5a3-e1083e4b142c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:36.464929 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8e1044d5-715b-4310-9f0e-1131bdbe097a tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:36.465378 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8e1044d5-715b-4310-9f0e-1131bdbe097a tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:36.466154 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8e1044d5-715b-4310-9f0e-1131bdbe097a tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:36.466588 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-8e1044d5-715b-4310-9f0e-1131bdbe097a tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:36.604629 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-8e1044d5-715b-4310-9f0e-1131bdbe097a tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:36.611798 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-8e1044d5-715b-4310-9f0e-1131bdbe097a tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c" status: 200 len: 1314 microversion: 2.1 time: 0.158650 Dec 27 14:34:36.612408 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 685/1392] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:36 2021] GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:37.628953 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-8867d0c5-398b-4788-8d4a-0ddeecd5fb93 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:37.629556 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-8867d0c5-398b-4788-8d4a-0ddeecd5fb93 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 21e9aa1f-ff09-4aac-b5a3-e1083e4b142c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:37.635920 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8867d0c5-398b-4788-8d4a-0ddeecd5fb93 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:37.636366 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8867d0c5-398b-4788-8d4a-0ddeecd5fb93 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:37.637136 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8867d0c5-398b-4788-8d4a-0ddeecd5fb93 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:37.637563 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-8867d0c5-398b-4788-8d4a-0ddeecd5fb93 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:37.765399 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-8867d0c5-398b-4788-8d4a-0ddeecd5fb93 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:37.772613 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-8867d0c5-398b-4788-8d4a-0ddeecd5fb93 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c" status: 200 len: 1498 microversion: 2.1 time: 0.147607 Dec 27 14:34:37.773185 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 708/1393] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:37 2021] GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:38.172892 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-06609334-6b14-49a1-87b7-bc32869d210b tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:38.173428 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-06609334-6b14-49a1-87b7-bc32869d210b tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 21e9aa1f-ff09-4aac-b5a3-e1083e4b142c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:38.179501 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-06609334-6b14-49a1-87b7-bc32869d210b tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:38.180746 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-06609334-6b14-49a1-87b7-bc32869d210b tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:38.181589 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-06609334-6b14-49a1-87b7-bc32869d210b tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:38.182133 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-06609334-6b14-49a1-87b7-bc32869d210b tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:38.206276 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-06609334-6b14-49a1-87b7-bc32869d210b tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 21e9aa1f-ff09-4aac-b5a3-e1083e4b142c] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 27 14:34:38.280777 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-06609334-6b14-49a1-87b7-bc32869d210b tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "DELETE /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c" status: 204 len: 0 microversion: 2.1 time: 0.111218 Dec 27 14:34:38.281760 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 686/1394] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Dec 27 14:34:38 2021] DELETE /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 27 14:34:38.290697 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-96624de8-aca8-4714-98a5-e2287951af72 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:38.291318 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-96624de8-aca8-4714-98a5-e2287951af72 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 21e9aa1f-ff09-4aac-b5a3-e1083e4b142c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:38.297078 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-96624de8-aca8-4714-98a5-e2287951af72 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:38.297526 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-96624de8-aca8-4714-98a5-e2287951af72 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:38.298304 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-96624de8-aca8-4714-98a5-e2287951af72 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:38.298737 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-96624de8-aca8-4714-98a5-e2287951af72 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:38.498877 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-96624de8-aca8-4714-98a5-e2287951af72 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:38.509648 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-96624de8-aca8-4714-98a5-e2287951af72 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c" status: 200 len: 1504 microversion: 2.1 time: 0.223393 Dec 27 14:34:38.510214 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 709/1395] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:38 2021] GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c => generated 1504 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:39.526852 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d43861cf-1202-46b5-98a3-195d5ba8d848 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:39.527554 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d43861cf-1202-46b5-98a3-195d5ba8d848 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 21e9aa1f-ff09-4aac-b5a3-e1083e4b142c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:39.534172 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d43861cf-1202-46b5-98a3-195d5ba8d848 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:39.534620 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d43861cf-1202-46b5-98a3-195d5ba8d848 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:39.535397 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d43861cf-1202-46b5-98a3-195d5ba8d848 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:39.535855 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d43861cf-1202-46b5-98a3-195d5ba8d848 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:39.668855 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d43861cf-1202-46b5-98a3-195d5ba8d848 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:39.676180 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d43861cf-1202-46b5-98a3-195d5ba8d848 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c" status: 200 len: 1504 microversion: 2.1 time: 0.153350 Dec 27 14:34:39.676737 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 687/1396] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:39 2021] GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:40.378215 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-8f229972-0c57-45c9-85ef-4d2f0886b72a req-97eacb58-a286-4b18-a0fc-da57d8adc192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e9aa1f-ff09-4aac-b5a3-e1083e4b142c", "name": "network-vif-deleted", "tag": "2397603d-1667-416f-9685-26fb43eae1a4"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:34:40.379729 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:34:40.379729 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:34:40.388729 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-8f229972-0c57-45c9-85ef-4d2f0886b72a req-97eacb58-a286-4b18-a0fc-da57d8adc192 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:40.389167 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-8f229972-0c57-45c9-85ef-4d2f0886b72a req-97eacb58-a286-4b18-a0fc-da57d8adc192 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:40.401861 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-8f229972-0c57-45c9-85ef-4d2f0886b72a req-97eacb58-a286-4b18-a0fc-da57d8adc192 service nova] Creating event network-vif-deleted:2397603d-1667-416f-9685-26fb43eae1a4 for instance 21e9aa1f-ff09-4aac-b5a3-e1083e4b142c on hv-cinder-82301 Dec 27 14:34:40.407704 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-8f229972-0c57-45c9-85ef-4d2f0886b72a req-97eacb58-a286-4b18-a0fc-da57d8adc192 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033058 Dec 27 14:34:40.408419 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 710/1397] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:34:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:34:40.694031 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4a0e91c2-1f01-452c-b95a-d2c3e89bf66d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:40.694638 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4a0e91c2-1f01-452c-b95a-d2c3e89bf66d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 21e9aa1f-ff09-4aac-b5a3-e1083e4b142c] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:40.701567 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a0e91c2-1f01-452c-b95a-d2c3e89bf66d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:40.702011 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a0e91c2-1f01-452c-b95a-d2c3e89bf66d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:40.702791 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a0e91c2-1f01-452c-b95a-d2c3e89bf66d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:40.703224 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a0e91c2-1f01-452c-b95a-d2c3e89bf66d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:40.733378 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a0e91c2-1f01-452c-b95a-d2c3e89bf66d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:40.733817 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4a0e91c2-1f01-452c-b95a-d2c3e89bf66d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:40.734262 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-4a0e91c2-1f01-452c-b95a-d2c3e89bf66d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lazy-loading 'fault' on Instance uuid 21e9aa1f-ff09-4aac-b5a3-e1083e4b142c {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:34:40.775172 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4a0e91c2-1f01-452c-b95a-d2c3e89bf66d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:40.782757 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4a0e91c2-1f01-452c-b95a-d2c3e89bf66d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c" status: 200 len: 1304 microversion: 2.1 time: 0.092333 Dec 27 14:34:40.783312 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 688/1398] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:40 2021] GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:41.799237 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-dbb7f1c2-b7d7-47a9-9e82-ee0ae8eda5f1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:41.799987 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-dbb7f1c2-b7d7-47a9-9e82-ee0ae8eda5f1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 21e9aa1f-ff09-4aac-b5a3-e1083e4b142c] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:41.807024 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dbb7f1c2-b7d7-47a9-9e82-ee0ae8eda5f1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:41.807466 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dbb7f1c2-b7d7-47a9-9e82-ee0ae8eda5f1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:41.808270 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dbb7f1c2-b7d7-47a9-9e82-ee0ae8eda5f1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:41.808704 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-dbb7f1c2-b7d7-47a9-9e82-ee0ae8eda5f1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:41.822073 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-dbb7f1c2-b7d7-47a9-9e82-ee0ae8eda5f1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] HTTP exception thrown: Instance 21e9aa1f-ff09-4aac-b5a3-e1083e4b142c could not be found. Dec 27 14:34:41.822657 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-dbb7f1c2-b7d7-47a9-9e82-ee0ae8eda5f1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Returning 404 to user: Instance 21e9aa1f-ff09-4aac-b5a3-e1083e4b142c could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:34:41.823466 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-dbb7f1c2-b7d7-47a9-9e82-ee0ae8eda5f1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c" status: 404 len: 111 microversion: 2.1 time: 0.028266 Dec 27 14:34:41.824020 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 711/1399] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:41 2021] GET /compute/v2.1/servers/21e9aa1f-ff09-4aac-b5a3-e1083e4b142c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:34:41.896088 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d92d1de5-162e-421b-8c15-0b0263f82952 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-400159888", "imageRef": "c8bd383f-96c5-4e2b-aaa5-fabd68b307f6", "flavorRef": "452", "networks": [{"uuid": "93681472-bb9b-4652-b7a4-ba722737b660"}]}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:34:41.947196 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.network.neutron [None req-d92d1de5-162e-421b-8c15-0b0263f82952 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] validate_networks() for [('93681472-bb9b-4652-b7a4-ba722737b660', None, None, None, None, None)] {{(pid=116104) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 27 14:34:42.280080 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-d92d1de5-162e-421b-8c15-0b0263f82952 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Flavor limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 27 14:34:42.280529 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-d92d1de5-162e-421b-8c15-0b0263f82952 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Image limits 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 27 14:34:42.280999 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-d92d1de5-162e-421b-8c15-0b0263f82952 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Flavor pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 27 14:34:42.281669 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-d92d1de5-162e-421b-8c15-0b0263f82952 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Image pref 0:0:0 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 27 14:34:42.282078 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.virt.hardware [None req-d92d1de5-162e-421b-8c15-0b0263f82952 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 27 14:34:42.291241 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d92d1de5-162e-421b-8c15-0b0263f82952 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:42.291682 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d92d1de5-162e-421b-8c15-0b0263f82952 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:42.292519 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d92d1de5-162e-421b-8c15-0b0263f82952 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:42.292950 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d92d1de5-162e-421b-8c15-0b0263f82952 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:42.309291 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-d92d1de5-162e-421b-8c15-0b0263f82952 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Getting quotas for project b306b1ad096c487198d782c3c57e0309. Resources: {'cores', 'ram', 'instances'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 27 14:34:42.313076 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.quota [None req-d92d1de5-162e-421b-8c15-0b0263f82952 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Getting quotas for user ad4fef8fff714ae9880cf4054b940607 and project b306b1ad096c487198d782c3c57e0309. Resources: {'cores', 'ram', 'instances'} {{(pid=116104) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 27 14:34:42.323634 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d92d1de5-162e-421b-8c15-0b0263f82952 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Going to run 1 instances... {{(pid=116104) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 27 14:34:42.325916 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d92d1de5-162e-421b-8c15-0b0263f82952 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 87978888-0643-4e78-aad1-86aea473b0f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c8bd383f-96c5-4e2b-aaa5-fabd68b307f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 27 14:34:42.369555 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d92d1de5-162e-421b-8c15-0b0263f82952 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.477128 Dec 27 14:34:42.370186 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 689/1400] 10.222.0.37 () {60 vars in 1146 bytes} [Mon Dec 27 14:34:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 27 14:34:42.379771 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-5ec6d2a1-b4e6-40a8-baab-5f052845d0bf tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:42.380349 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-5ec6d2a1-b4e6-40a8-baab-5f052845d0bf tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 87978888-0643-4e78-aad1-86aea473b0f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:42.431780 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-5ec6d2a1-b4e6-40a8-baab-5f052845d0bf tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:42.438430 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-5ec6d2a1-b4e6-40a8-baab-5f052845d0bf tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4" status: 200 len: 1213 microversion: 2.1 time: 0.062306 Dec 27 14:34:42.438997 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 712/1401] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:42 2021] GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4 => generated 1213 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:43.455359 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5db2a191-8bca-42cf-9de5-a3cfb2c96489 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:43.456109 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5db2a191-8bca-42cf-9de5-a3cfb2c96489 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 87978888-0643-4e78-aad1-86aea473b0f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:43.463990 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5db2a191-8bca-42cf-9de5-a3cfb2c96489 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:43.464440 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5db2a191-8bca-42cf-9de5-a3cfb2c96489 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:43.465244 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5db2a191-8bca-42cf-9de5-a3cfb2c96489 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:43.465674 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5db2a191-8bca-42cf-9de5-a3cfb2c96489 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:43.533485 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5db2a191-8bca-42cf-9de5-a3cfb2c96489 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:43.541245 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5db2a191-8bca-42cf-9de5-a3cfb2c96489 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4" status: 200 len: 1271 microversion: 2.1 time: 0.089999 Dec 27 14:34:43.541828 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 690/1402] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:43 2021] GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:44.558765 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-2aadd306-69d2-47c6-8f7c-0bcf332fc334 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:44.559552 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-2aadd306-69d2-47c6-8f7c-0bcf332fc334 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 87978888-0643-4e78-aad1-86aea473b0f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:44.566643 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2aadd306-69d2-47c6-8f7c-0bcf332fc334 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:44.567097 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2aadd306-69d2-47c6-8f7c-0bcf332fc334 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:44.567951 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2aadd306-69d2-47c6-8f7c-0bcf332fc334 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:44.568392 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-2aadd306-69d2-47c6-8f7c-0bcf332fc334 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:44.782678 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-2aadd306-69d2-47c6-8f7c-0bcf332fc334 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:44.791106 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-2aadd306-69d2-47c6-8f7c-0bcf332fc334 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4" status: 200 len: 1313 microversion: 2.1 time: 0.236610 Dec 27 14:34:44.791697 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 713/1403] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:44 2021] GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4 => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:34:44.803874 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-018e75da-a961-41d5-9f37-b5e34068e68e req-0e141f71-1686-4669-b13e-28d6dbafbb26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87978888-0643-4e78-aad1-86aea473b0f4", "tag": "71357f0d-d38b-4e6d-952f-fa18fa4bb948"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:34:44.805890 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:34:44.805890 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:34:44.814596 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-018e75da-a961-41d5-9f37-b5e34068e68e req-0e141f71-1686-4669-b13e-28d6dbafbb26 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:44.815041 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-018e75da-a961-41d5-9f37-b5e34068e68e req-0e141f71-1686-4669-b13e-28d6dbafbb26 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:44.827153 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-018e75da-a961-41d5-9f37-b5e34068e68e req-0e141f71-1686-4669-b13e-28d6dbafbb26 service nova] Creating event network-changed:71357f0d-d38b-4e6d-952f-fa18fa4bb948 for instance 87978888-0643-4e78-aad1-86aea473b0f4 on hv-cinder-82301 Dec 27 14:34:44.832431 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-018e75da-a961-41d5-9f37-b5e34068e68e req-0e141f71-1686-4669-b13e-28d6dbafbb26 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032197 Dec 27 14:34:44.833190 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 691/1404] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:34:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:34:45.808160 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-cc70313b-609d-44d7-bd1b-b8e3d5cc49fc tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:45.808776 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-cc70313b-609d-44d7-bd1b-b8e3d5cc49fc tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 87978888-0643-4e78-aad1-86aea473b0f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:45.815122 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc70313b-609d-44d7-bd1b-b8e3d5cc49fc tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:45.815570 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc70313b-609d-44d7-bd1b-b8e3d5cc49fc tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:45.816379 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc70313b-609d-44d7-bd1b-b8e3d5cc49fc tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:45.816818 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-cc70313b-609d-44d7-bd1b-b8e3d5cc49fc tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:45.944874 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-cc70313b-609d-44d7-bd1b-b8e3d5cc49fc tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:45.952089 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-cc70313b-609d-44d7-bd1b-b8e3d5cc49fc tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4" status: 200 len: 1313 microversion: 2.1 time: 0.148395 Dec 27 14:34:45.952651 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 714/1405] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:45 2021] GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:46.969083 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7f8ab2ea-572d-4f94-9843-45a6e9adac96 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:46.969784 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7f8ab2ea-572d-4f94-9843-45a6e9adac96 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 87978888-0643-4e78-aad1-86aea473b0f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:46.976407 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7f8ab2ea-572d-4f94-9843-45a6e9adac96 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:46.977428 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7f8ab2ea-572d-4f94-9843-45a6e9adac96 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:46.978219 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7f8ab2ea-572d-4f94-9843-45a6e9adac96 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:46.978660 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7f8ab2ea-572d-4f94-9843-45a6e9adac96 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:47.108386 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7f8ab2ea-572d-4f94-9843-45a6e9adac96 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:47.115546 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7f8ab2ea-572d-4f94-9843-45a6e9adac96 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4" status: 200 len: 1313 microversion: 2.1 time: 0.150522 Dec 27 14:34:47.116134 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 692/1406] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:46 2021] GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:48.133575 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-b716c544-4f51-49e2-8de7-f38244e6f567 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:48.134180 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-b716c544-4f51-49e2-8de7-f38244e6f567 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 87978888-0643-4e78-aad1-86aea473b0f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:48.140552 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b716c544-4f51-49e2-8de7-f38244e6f567 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:48.141000 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b716c544-4f51-49e2-8de7-f38244e6f567 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:48.141779 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b716c544-4f51-49e2-8de7-f38244e6f567 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:48.142214 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-b716c544-4f51-49e2-8de7-f38244e6f567 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:48.276805 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-b716c544-4f51-49e2-8de7-f38244e6f567 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:48.285452 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-b716c544-4f51-49e2-8de7-f38244e6f567 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4" status: 200 len: 1313 microversion: 2.1 time: 0.156324 Dec 27 14:34:48.286033 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 715/1407] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:48 2021] GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:49.302021 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-5a128350-efe2-4131-82d5-a1179cf7f134 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:49.302801 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-5a128350-efe2-4131-82d5-a1179cf7f134 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 87978888-0643-4e78-aad1-86aea473b0f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:49.309260 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a128350-efe2-4131-82d5-a1179cf7f134 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:49.309783 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a128350-efe2-4131-82d5-a1179cf7f134 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:49.310637 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a128350-efe2-4131-82d5-a1179cf7f134 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:49.311071 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-5a128350-efe2-4131-82d5-a1179cf7f134 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:49.443853 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-5a128350-efe2-4131-82d5-a1179cf7f134 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:49.451846 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-5a128350-efe2-4131-82d5-a1179cf7f134 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4" status: 200 len: 1313 microversion: 2.1 time: 0.153522 Dec 27 14:34:49.452644 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 693/1408] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:49 2021] GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:50.467170 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a4007836-b191-4ed4-8647-3acd63d99d13 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:50.467797 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a4007836-b191-4ed4-8647-3acd63d99d13 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 87978888-0643-4e78-aad1-86aea473b0f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:50.474130 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a4007836-b191-4ed4-8647-3acd63d99d13 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:50.474580 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a4007836-b191-4ed4-8647-3acd63d99d13 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:50.475352 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a4007836-b191-4ed4-8647-3acd63d99d13 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:50.475782 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a4007836-b191-4ed4-8647-3acd63d99d13 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:50.605172 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a4007836-b191-4ed4-8647-3acd63d99d13 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:50.612247 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a4007836-b191-4ed4-8647-3acd63d99d13 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4" status: 200 len: 1313 microversion: 2.1 time: 0.148690 Dec 27 14:34:50.612810 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 716/1409] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:50 2021] GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:51.323456 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [req-08ad886f-aeb7-4741-9803-a731040cf1d1 req-7c1efe55-13a8-450a-b6fd-60bb8731249b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87978888-0643-4e78-aad1-86aea473b0f4", "name": "network-vif-plugged", "status": "completed", "tag": "71357f0d-d38b-4e6d-952f-fa18fa4bb948"}]} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:34:51.324999 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:34:51.324999 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: warnings.warn(msg) Dec 27 14:34:51.332621 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-08ad886f-aeb7-4741-9803-a731040cf1d1 req-7c1efe55-13a8-450a-b6fd-60bb8731249b service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:51.333081 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [req-08ad886f-aeb7-4741-9803-a731040cf1d1 req-7c1efe55-13a8-450a-b6fd-60bb8731249b service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:51.344746 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.compute.server_external_events [req-08ad886f-aeb7-4741-9803-a731040cf1d1 req-7c1efe55-13a8-450a-b6fd-60bb8731249b service nova] Creating event network-vif-plugged:71357f0d-d38b-4e6d-952f-fa18fa4bb948 for instance 87978888-0643-4e78-aad1-86aea473b0f4 on hv-cinder-82301 Dec 27 14:34:51.349982 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [req-08ad886f-aeb7-4741-9803-a731040cf1d1 req-7c1efe55-13a8-450a-b6fd-60bb8731249b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030213 Dec 27 14:34:51.350606 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 694/1410] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:34:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:34:51.628719 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-aa7ef90d-138b-47a9-9b0a-84ba48a581c0 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:51.629327 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-aa7ef90d-138b-47a9-9b0a-84ba48a581c0 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 87978888-0643-4e78-aad1-86aea473b0f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:51.636560 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa7ef90d-138b-47a9-9b0a-84ba48a581c0 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:51.637011 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa7ef90d-138b-47a9-9b0a-84ba48a581c0 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:51.637800 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa7ef90d-138b-47a9-9b0a-84ba48a581c0 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:51.638235 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-aa7ef90d-138b-47a9-9b0a-84ba48a581c0 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:51.766475 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-aa7ef90d-138b-47a9-9b0a-84ba48a581c0 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:51.773879 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-aa7ef90d-138b-47a9-9b0a-84ba48a581c0 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4" status: 200 len: 1313 microversion: 2.1 time: 0.148634 Dec 27 14:34:51.774458 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 717/1411] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:51 2021] GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:52.791453 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-2c19c9b2-f5f7-4c8f-85b2-df04a1be12e8 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:52.792182 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-2c19c9b2-f5f7-4c8f-85b2-df04a1be12e8 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 87978888-0643-4e78-aad1-86aea473b0f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:52.798311 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c19c9b2-f5f7-4c8f-85b2-df04a1be12e8 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:52.798759 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c19c9b2-f5f7-4c8f-85b2-df04a1be12e8 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:52.799539 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c19c9b2-f5f7-4c8f-85b2-df04a1be12e8 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:52.800010 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-2c19c9b2-f5f7-4c8f-85b2-df04a1be12e8 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:52.930460 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-2c19c9b2-f5f7-4c8f-85b2-df04a1be12e8 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:52.937778 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-2c19c9b2-f5f7-4c8f-85b2-df04a1be12e8 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4" status: 200 len: 1313 microversion: 2.1 time: 0.150805 Dec 27 14:34:52.938350 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 695/1412] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:52 2021] GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:53.954743 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fc7065c6-014e-4d40-9337-59e3f7ba70c1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:53.955351 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fc7065c6-014e-4d40-9337-59e3f7ba70c1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 87978888-0643-4e78-aad1-86aea473b0f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:53.962529 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fc7065c6-014e-4d40-9337-59e3f7ba70c1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:53.962976 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fc7065c6-014e-4d40-9337-59e3f7ba70c1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:53.963794 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fc7065c6-014e-4d40-9337-59e3f7ba70c1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:53.964260 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fc7065c6-014e-4d40-9337-59e3f7ba70c1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:54.094283 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-fc7065c6-014e-4d40-9337-59e3f7ba70c1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:54.101603 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fc7065c6-014e-4d40-9337-59e3f7ba70c1 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4" status: 200 len: 1498 microversion: 2.1 time: 0.150478 Dec 27 14:34:54.102170 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 718/1413] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:53 2021] GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4 => generated 1498 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:54.523412 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-6bf067b1-54a7-4a6e-9053-f36fb14f06db tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:54.523968 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6bf067b1-54a7-4a6e-9053-f36fb14f06db tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 87978888-0643-4e78-aad1-86aea473b0f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:54.530179 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6bf067b1-54a7-4a6e-9053-f36fb14f06db tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:54.530624 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6bf067b1-54a7-4a6e-9053-f36fb14f06db tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:54.531723 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6bf067b1-54a7-4a6e-9053-f36fb14f06db tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:54.532184 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-6bf067b1-54a7-4a6e-9053-f36fb14f06db tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:54.556619 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-6bf067b1-54a7-4a6e-9053-f36fb14f06db tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 87978888-0643-4e78-aad1-86aea473b0f4] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 27 14:34:54.631238 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-6bf067b1-54a7-4a6e-9053-f36fb14f06db tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "DELETE /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4" status: 204 len: 0 microversion: 2.1 time: 0.111003 Dec 27 14:34:54.631932 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 696/1414] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Dec 27 14:34:54 2021] DELETE /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 27 14:34:54.640664 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a17351d1-bb3f-4a15-80ec-78c337343423 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:54.641265 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a17351d1-bb3f-4a15-80ec-78c337343423 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 87978888-0643-4e78-aad1-86aea473b0f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:54.647032 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a17351d1-bb3f-4a15-80ec-78c337343423 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:54.647476 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a17351d1-bb3f-4a15-80ec-78c337343423 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:54.648990 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a17351d1-bb3f-4a15-80ec-78c337343423 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:54.649424 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a17351d1-bb3f-4a15-80ec-78c337343423 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:54.778281 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a17351d1-bb3f-4a15-80ec-78c337343423 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:54.785755 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a17351d1-bb3f-4a15-80ec-78c337343423 tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4" status: 200 len: 1504 microversion: 2.1 time: 0.148678 Dec 27 14:34:54.786325 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 719/1415] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:54 2021] GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:34:55.804388 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f1ea61a4-3484-49ac-b924-862e3d2b48cd tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:55.805084 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f1ea61a4-3484-49ac-b924-862e3d2b48cd tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 87978888-0643-4e78-aad1-86aea473b0f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:55.811451 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1ea61a4-3484-49ac-b924-862e3d2b48cd tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:55.811923 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1ea61a4-3484-49ac-b924-862e3d2b48cd tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:55.812697 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1ea61a4-3484-49ac-b924-862e3d2b48cd tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:55.813126 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f1ea61a4-3484-49ac-b924-862e3d2b48cd tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:55.943813 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f1ea61a4-3484-49ac-b924-862e3d2b48cd tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:55.951107 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f1ea61a4-3484-49ac-b924-862e3d2b48cd tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4" status: 200 len: 1504 microversion: 2.1 time: 0.150752 Dec 27 14:34:55.951660 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 697/1416] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:55 2021] GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:56.747869 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-0a9a84cd-c3c6-4c05-9ebd-a2941307c9ac req-828a95c1-de89-4185-8447-80a47e1280ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87978888-0643-4e78-aad1-86aea473b0f4", "name": "network-vif-deleted", "tag": "71357f0d-d38b-4e6d-952f-fa18fa4bb948"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:34:56.749819 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:34:56.749819 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:34:56.758651 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-0a9a84cd-c3c6-4c05-9ebd-a2941307c9ac req-828a95c1-de89-4185-8447-80a47e1280ab service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:56.759220 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-0a9a84cd-c3c6-4c05-9ebd-a2941307c9ac req-828a95c1-de89-4185-8447-80a47e1280ab service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:56.771269 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-0a9a84cd-c3c6-4c05-9ebd-a2941307c9ac req-828a95c1-de89-4185-8447-80a47e1280ab service nova] Creating event network-vif-deleted:71357f0d-d38b-4e6d-952f-fa18fa4bb948 for instance 87978888-0643-4e78-aad1-86aea473b0f4 on hv-cinder-82301 Dec 27 14:34:56.777705 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-0a9a84cd-c3c6-4c05-9ebd-a2941307c9ac req-828a95c1-de89-4185-8447-80a47e1280ab service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034227 Dec 27 14:34:56.778300 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 720/1417] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:34:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:34:56.968232 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-f83f3ba7-0594-4003-9a86-1b16a7375b1e tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:56.968779 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-f83f3ba7-0594-4003-9a86-1b16a7375b1e tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 87978888-0643-4e78-aad1-86aea473b0f4] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:56.974896 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f83f3ba7-0594-4003-9a86-1b16a7375b1e tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:56.975337 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f83f3ba7-0594-4003-9a86-1b16a7375b1e tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:56.976136 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f83f3ba7-0594-4003-9a86-1b16a7375b1e tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:56.976565 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f83f3ba7-0594-4003-9a86-1b16a7375b1e tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:57.005697 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f83f3ba7-0594-4003-9a86-1b16a7375b1e tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:57.006138 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-f83f3ba7-0594-4003-9a86-1b16a7375b1e tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:57.006576 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-f83f3ba7-0594-4003-9a86-1b16a7375b1e tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lazy-loading 'fault' on Instance uuid 87978888-0643-4e78-aad1-86aea473b0f4 {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:34:57.046885 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-f83f3ba7-0594-4003-9a86-1b16a7375b1e tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4fef8fff714ae9880cf4054b940607', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b306b1ad096c487198d782c3c57e0309', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:34:57.054243 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-f83f3ba7-0594-4003-9a86-1b16a7375b1e tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4" status: 200 len: 1303 microversion: 2.1 time: 0.089751 Dec 27 14:34:57.054796 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 698/1418] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:56 2021] GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4 => generated 1303 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:34:58.070695 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ff84ace9-7e40-436c-8bc9-0e309083172d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:34:58.071441 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ff84ace9-7e40-436c-8bc9-0e309083172d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] [instance: 87978888-0643-4e78-aad1-86aea473b0f4] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:34:58.077904 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ff84ace9-7e40-436c-8bc9-0e309083172d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:58.078350 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ff84ace9-7e40-436c-8bc9-0e309083172d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:58.079126 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ff84ace9-7e40-436c-8bc9-0e309083172d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:34:58.079557 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ff84ace9-7e40-436c-8bc9-0e309083172d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:34:58.092849 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-ff84ace9-7e40-436c-8bc9-0e309083172d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] HTTP exception thrown: Instance 87978888-0643-4e78-aad1-86aea473b0f4 could not be found. Dec 27 14:34:58.093422 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ff84ace9-7e40-436c-8bc9-0e309083172d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] Returning 404 to user: Instance 87978888-0643-4e78-aad1-86aea473b0f4 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:34:58.094248 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ff84ace9-7e40-436c-8bc9-0e309083172d tempest-VolumesActionsTest-835898804 tempest-VolumesActionsTest-835898804-project] 10.222.0.37 "GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4" status: 404 len: 111 microversion: 2.1 time: 0.027573 Dec 27 14:34:58.094761 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 721/1419] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:34:58 2021] GET /compute/v2.1/servers/87978888-0643-4e78-aad1-86aea473b0f4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:36:12.324836 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-05d62a35-d03e-437d-ab48-ae476a2601a8 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:12.325385 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-05d62a35-d03e-437d-ab48-ae476a2601a8 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:12.327592 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-a8bfd206-f48c-4977-8efb-b499ea8b3546 req-8c2cd960-c6f6-4b03-955b-d4ee0fa565fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0020d108-ee79-44c1-9c9c-a9997b2faaaf", "tag": "bde15cb2-a719-4fb8-bf08-5322cd10f256"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:36:12.329229 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:36:12.329229 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:36:12.332057 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05d62a35-d03e-437d-ab48-ae476a2601a8 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:12.332839 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05d62a35-d03e-437d-ab48-ae476a2601a8 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:12.333280 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05d62a35-d03e-437d-ab48-ae476a2601a8 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:12.333709 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-05d62a35-d03e-437d-ab48-ae476a2601a8 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:12.336632 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-a8bfd206-f48c-4977-8efb-b499ea8b3546 req-8c2cd960-c6f6-4b03-955b-d4ee0fa565fc service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:12.337152 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-a8bfd206-f48c-4977-8efb-b499ea8b3546 req-8c2cd960-c6f6-4b03-955b-d4ee0fa565fc service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:12.351612 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-a8bfd206-f48c-4977-8efb-b499ea8b3546 req-8c2cd960-c6f6-4b03-955b-d4ee0fa565fc service nova] Creating event network-changed:bde15cb2-a719-4fb8-bf08-5322cd10f256 for instance 0020d108-ee79-44c1-9c9c-a9997b2faaaf on hv-cinder-82301 Dec 27 14:36:12.357353 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-a8bfd206-f48c-4977-8efb-b499ea8b3546 req-8c2cd960-c6f6-4b03-955b-d4ee0fa565fc service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035203 Dec 27 14:36:12.358162 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 722/1420] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:36:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:36:12.359732 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-05d62a35-d03e-437d-ab48-ae476a2601a8 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 27 14:36:12.446355 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-05d62a35-d03e-437d-ab48-ae476a2601a8 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "DELETE /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 204 len: 0 microversion: 2.1 time: 0.126698 Dec 27 14:36:12.448232 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 699/1421] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Dec 27 14:36:12 2021] DELETE /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 27 14:36:12.457649 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-3f501c82-13c9-47de-8eb7-7c8dde15f148 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:12.458358 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-3f501c82-13c9-47de-8eb7-7c8dde15f148 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:12.465396 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3f501c82-13c9-47de-8eb7-7c8dde15f148 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:12.465907 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3f501c82-13c9-47de-8eb7-7c8dde15f148 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:12.466706 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3f501c82-13c9-47de-8eb7-7c8dde15f148 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:12.467146 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-3f501c82-13c9-47de-8eb7-7c8dde15f148 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:12.688499 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-3f501c82-13c9-47de-8eb7-7c8dde15f148 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:36:12.696786 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-3f501c82-13c9-47de-8eb7-7c8dde15f148 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 200 len: 1575 microversion: 2.1 time: 0.243380 Dec 27 14:36:12.697607 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 723/1422] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:36:12 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 1575 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:36:13.716708 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e2f74498-7911-414b-a3e8-ec34f6ba99cf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:13.717419 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e2f74498-7911-414b-a3e8-ec34f6ba99cf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:13.723892 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2f74498-7911-414b-a3e8-ec34f6ba99cf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:13.724350 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2f74498-7911-414b-a3e8-ec34f6ba99cf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:13.725132 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2f74498-7911-414b-a3e8-ec34f6ba99cf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:13.725569 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e2f74498-7911-414b-a3e8-ec34f6ba99cf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:13.860428 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-e2f74498-7911-414b-a3e8-ec34f6ba99cf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:36:13.867731 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e2f74498-7911-414b-a3e8-ec34f6ba99cf tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 200 len: 1457 microversion: 2.1 time: 0.155749 Dec 27 14:36:13.868329 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 700/1423] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:36:13 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 1457 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:36:14.830349 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-43a22cab-2475-4840-a016-712c25d67c70 req-02c2211b-9c95-40c4-b46b-a4102ec483c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0020d108-ee79-44c1-9c9c-a9997b2faaaf", "name": "network-vif-deleted", "tag": "bde15cb2-a719-4fb8-bf08-5322cd10f256"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:36:14.831980 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:36:14.831980 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:36:14.839235 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-43a22cab-2475-4840-a016-712c25d67c70 req-02c2211b-9c95-40c4-b46b-a4102ec483c0 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:14.839932 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-43a22cab-2475-4840-a016-712c25d67c70 req-02c2211b-9c95-40c4-b46b-a4102ec483c0 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:14.850741 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-43a22cab-2475-4840-a016-712c25d67c70 req-02c2211b-9c95-40c4-b46b-a4102ec483c0 service nova] Creating event network-vif-deleted:bde15cb2-a719-4fb8-bf08-5322cd10f256 for instance 0020d108-ee79-44c1-9c9c-a9997b2faaaf on hv-cinder-82301 Dec 27 14:36:14.856239 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-43a22cab-2475-4840-a016-712c25d67c70 req-02c2211b-9c95-40c4-b46b-a4102ec483c0 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029438 Dec 27 14:36:14.856834 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 724/1424] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:36:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:36:14.890218 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-dda7cfc4-b2b8-445f-b6ed-1ff4f2f6162d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:14.890834 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-dda7cfc4-b2b8-445f-b6ed-1ff4f2f6162d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:14.897080 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dda7cfc4-b2b8-445f-b6ed-1ff4f2f6162d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:14.897610 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dda7cfc4-b2b8-445f-b6ed-1ff4f2f6162d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:14.898323 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dda7cfc4-b2b8-445f-b6ed-1ff4f2f6162d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:14.898757 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-dda7cfc4-b2b8-445f-b6ed-1ff4f2f6162d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:14.959168 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-dda7cfc4-b2b8-445f-b6ed-1ff4f2f6162d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:36:14.966869 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-dda7cfc4-b2b8-445f-b6ed-1ff4f2f6162d tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 200 len: 1224 microversion: 2.1 time: 0.080268 Dec 27 14:36:14.967428 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 701/1425] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:36:14 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:36:15.984536 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ce60cda0-352c-4357-9049-4f4e56d6b458 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:15.985272 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ce60cda0-352c-4357-9049-4f4e56d6b458 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 0020d108-ee79-44c1-9c9c-a9997b2faaaf] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:15.991410 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce60cda0-352c-4357-9049-4f4e56d6b458 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:15.991885 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce60cda0-352c-4357-9049-4f4e56d6b458 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:15.992674 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce60cda0-352c-4357-9049-4f4e56d6b458 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:15.993114 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ce60cda0-352c-4357-9049-4f4e56d6b458 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:16.006501 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-ce60cda0-352c-4357-9049-4f4e56d6b458 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] HTTP exception thrown: Instance 0020d108-ee79-44c1-9c9c-a9997b2faaaf could not be found. Dec 27 14:36:16.007083 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ce60cda0-352c-4357-9049-4f4e56d6b458 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Returning 404 to user: Instance 0020d108-ee79-44c1-9c9c-a9997b2faaaf could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:36:16.007917 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ce60cda0-352c-4357-9049-4f4e56d6b458 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf" status: 404 len: 111 microversion: 2.1 time: 0.027998 Dec 27 14:36:16.008477 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 725/1426] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:36:15 2021] GET /compute/v2.1/servers/0020d108-ee79-44c1-9c9c-a9997b2faaaf => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:36:19.300386 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-adaa17b5-c033-40f8-bc23-27429401b184 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:19.300906 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-adaa17b5-c033-40f8-bc23-27429401b184 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: a929808f-f43c-4753-b748-dd6d74500c13] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:19.302743 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-5a60174a-0764-4010-9d8d-9ea5fe8dc40a req-5695b904-c7e3-4f65-8800-df4aba8e669e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a929808f-f43c-4753-b748-dd6d74500c13", "tag": "d2f2dd8e-ec15-4733-83a0-a34345736d8d"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:36:19.304549 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:36:19.304549 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:36:19.311858 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-5a60174a-0764-4010-9d8d-9ea5fe8dc40a req-5695b904-c7e3-4f65-8800-df4aba8e669e service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:19.312395 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-5a60174a-0764-4010-9d8d-9ea5fe8dc40a req-5695b904-c7e3-4f65-8800-df4aba8e669e service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:19.319175 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-adaa17b5-c033-40f8-bc23-27429401b184 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:19.319631 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-adaa17b5-c033-40f8-bc23-27429401b184 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:19.320534 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-adaa17b5-c033-40f8-bc23-27429401b184 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:19.320973 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-adaa17b5-c033-40f8-bc23-27429401b184 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:19.341306 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-5a60174a-0764-4010-9d8d-9ea5fe8dc40a req-5695b904-c7e3-4f65-8800-df4aba8e669e service nova] Creating event network-changed:d2f2dd8e-ec15-4733-83a0-a34345736d8d for instance a929808f-f43c-4753-b748-dd6d74500c13 on hv-cinder-82301 Dec 27 14:36:19.348090 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-5a60174a-0764-4010-9d8d-9ea5fe8dc40a req-5695b904-c7e3-4f65-8800-df4aba8e669e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049117 Dec 27 14:36:19.348810 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-adaa17b5-c033-40f8-bc23-27429401b184 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: a929808f-f43c-4753-b748-dd6d74500c13] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 27 14:36:19.349317 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 726/1427] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:36:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:36:19.436321 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-adaa17b5-c033-40f8-bc23-27429401b184 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "DELETE /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13" status: 204 len: 0 microversion: 2.1 time: 0.139623 Dec 27 14:36:19.443742 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 702/1428] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Dec 27 14:36:19 2021] DELETE /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 27 14:36:19.452856 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-7ccf4313-d676-4de3-b8e1-0e1e9e81929e tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:19.453658 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-7ccf4313-d676-4de3-b8e1-0e1e9e81929e tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: a929808f-f43c-4753-b748-dd6d74500c13] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:19.460057 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7ccf4313-d676-4de3-b8e1-0e1e9e81929e tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:19.460509 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7ccf4313-d676-4de3-b8e1-0e1e9e81929e tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:19.461305 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7ccf4313-d676-4de3-b8e1-0e1e9e81929e tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:19.461933 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-7ccf4313-d676-4de3-b8e1-0e1e9e81929e tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:19.685634 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-7ccf4313-d676-4de3-b8e1-0e1e9e81929e tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:36:19.693009 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-7ccf4313-d676-4de3-b8e1-0e1e9e81929e tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13" status: 200 len: 1575 microversion: 2.1 time: 0.244871 Dec 27 14:36:19.694032 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 727/1429] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:36:19 2021] GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13 => generated 1575 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:36:20.711692 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-4ddb8d48-0d59-44c8-ba48-99a98687f165 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:20.712422 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-4ddb8d48-0d59-44c8-ba48-99a98687f165 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: a929808f-f43c-4753-b748-dd6d74500c13] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:20.718947 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ddb8d48-0d59-44c8-ba48-99a98687f165 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:20.719395 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ddb8d48-0d59-44c8-ba48-99a98687f165 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:20.720207 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ddb8d48-0d59-44c8-ba48-99a98687f165 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:20.720642 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-4ddb8d48-0d59-44c8-ba48-99a98687f165 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:20.780452 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-4ddb8d48-0d59-44c8-ba48-99a98687f165 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529e9e9288714c6297be093f1a5e8163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05268adb4a234195999f6992b93b3175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:36:20.788117 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-4ddb8d48-0d59-44c8-ba48-99a98687f165 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13" status: 200 len: 1224 microversion: 2.1 time: 0.080481 Dec 27 14:36:20.788685 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 703/1430] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:36:20 2021] GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:36:21.363579 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-8bcffaa9-c6cf-438e-a6a3-79622d4ed6f8 req-c20ddaca-7789-4f2c-9f47-fcb5c1b0fa77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a929808f-f43c-4753-b748-dd6d74500c13", "name": "network-vif-deleted", "tag": "d2f2dd8e-ec15-4733-83a0-a34345736d8d"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:36:21.365163 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:36:21.365163 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:36:21.372602 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-8bcffaa9-c6cf-438e-a6a3-79622d4ed6f8 req-c20ddaca-7789-4f2c-9f47-fcb5c1b0fa77 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:21.373046 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-8bcffaa9-c6cf-438e-a6a3-79622d4ed6f8 req-c20ddaca-7789-4f2c-9f47-fcb5c1b0fa77 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:21.383504 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-8bcffaa9-c6cf-438e-a6a3-79622d4ed6f8 req-c20ddaca-7789-4f2c-9f47-fcb5c1b0fa77 service nova] Creating event network-vif-deleted:d2f2dd8e-ec15-4733-83a0-a34345736d8d for instance a929808f-f43c-4753-b748-dd6d74500c13 on hv-cinder-82301 Dec 27 14:36:21.388299 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-8bcffaa9-c6cf-438e-a6a3-79622d4ed6f8 req-c20ddaca-7789-4f2c-9f47-fcb5c1b0fa77 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028317 Dec 27 14:36:21.388863 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 728/1431] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:36:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:36:21.437171 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 27 14:36:21.437330 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: Mon Dec 27 14:36:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 27 14:36:21.805630 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-68c01066-eb43-4bdf-8b0b-57b0646a21f7 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:21.806239 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-68c01066-eb43-4bdf-8b0b-57b0646a21f7 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: a929808f-f43c-4753-b748-dd6d74500c13] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:21.812613 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68c01066-eb43-4bdf-8b0b-57b0646a21f7 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:21.813061 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68c01066-eb43-4bdf-8b0b-57b0646a21f7 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:21.813836 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68c01066-eb43-4bdf-8b0b-57b0646a21f7 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:21.814266 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-68c01066-eb43-4bdf-8b0b-57b0646a21f7 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:21.827569 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-68c01066-eb43-4bdf-8b0b-57b0646a21f7 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] HTTP exception thrown: Instance a929808f-f43c-4753-b748-dd6d74500c13 could not be found. Dec 27 14:36:21.828175 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-68c01066-eb43-4bdf-8b0b-57b0646a21f7 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Returning 404 to user: Instance a929808f-f43c-4753-b748-dd6d74500c13 could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:36:21.828965 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-68c01066-eb43-4bdf-8b0b-57b0646a21f7 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13" status: 404 len: 111 microversion: 2.1 time: 0.027020 Dec 27 14:36:21.829478 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 704/1432] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:36:21 2021] GET /compute/v2.1/servers/a929808f-f43c-4753-b748-dd6d74500c13 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:36:22.277402 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-02af67f0-c93d-4ac0-8cc9-30741d609bcc tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:22.277981 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-02af67f0-c93d-4ac0-8cc9-30741d609bcc tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:22.284547 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-02af67f0-c93d-4ac0-8cc9-30741d609bcc tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:22.284995 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-02af67f0-c93d-4ac0-8cc9-30741d609bcc tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:22.285772 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-02af67f0-c93d-4ac0-8cc9-30741d609bcc tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:22.286207 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-02af67f0-c93d-4ac0-8cc9-30741d609bcc tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:22.299638 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-02af67f0-c93d-4ac0-8cc9-30741d609bcc tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] HTTP exception thrown: Instance 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d could not be found. Dec 27 14:36:22.300251 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-02af67f0-c93d-4ac0-8cc9-30741d609bcc tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Returning 404 to user: Instance 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:36:22.301166 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-02af67f0-c93d-4ac0-8cc9-30741d609bcc tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "DELETE /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d" status: 404 len: 111 microversion: 2.1 time: 0.027894 Dec 27 14:36:22.301699 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 729/1433] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Dec 27 14:36:22 2021] DELETE /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:36:22.310257 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-aaf4f0a0-d751-4fc4-a82c-3f84ab120c82 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:22.310880 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-aaf4f0a0-d751-4fc4-a82c-3f84ab120c82 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] [instance: 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:22.316801 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aaf4f0a0-d751-4fc4-a82c-3f84ab120c82 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:22.317258 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aaf4f0a0-d751-4fc4-a82c-3f84ab120c82 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:22.318047 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aaf4f0a0-d751-4fc4-a82c-3f84ab120c82 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:22.318489 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-aaf4f0a0-d751-4fc4-a82c-3f84ab120c82 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:22.331787 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.wsgi [None req-aaf4f0a0-d751-4fc4-a82c-3f84ab120c82 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] HTTP exception thrown: Instance 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d could not be found. Dec 27 14:36:22.332400 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-aaf4f0a0-d751-4fc4-a82c-3f84ab120c82 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Returning 404 to user: Instance 4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d could not be found. {{(pid=116104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:36:22.333202 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-aaf4f0a0-d751-4fc4-a82c-3f84ab120c82 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d" status: 404 len: 111 microversion: 2.1 time: 0.027405 Dec 27 14:36:22.333718 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 705/1434] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:36:22 2021] GET /compute/v2.1/servers/4b6f7a1b-90e3-47ff-90b7-fac0d8b7fb5d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 27 14:36:23.603031 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-23140a09-e0a3-4746-9e57-bb83f4069b07 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] Calling method '.version_select at 0x7f80281d8ee0>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:23.627429 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-23140a09-e0a3-4746-9e57-bb83f4069b07 tempest-TestVolumeBootPattern-309495959 tempest-TestVolumeBootPattern-309495959-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-200701949" status: 202 len: 0 microversion: 2.1 time: 0.028049 Dec 27 14:36:23.628299 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 730/1435] 10.222.0.37 () {58 vars in 1259 bytes} [Mon Dec 27 14:36:23 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-200701949 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:36:45.541000 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-e390cddb-dc47-4a68-a17f-df36079e6540 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:36:45.541617 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-e390cddb-dc47-4a68-a17f-df36079e6540 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:45.547517 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e390cddb-dc47-4a68-a17f-df36079e6540 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:45.547996 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e390cddb-dc47-4a68-a17f-df36079e6540 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:45.548777 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e390cddb-dc47-4a68-a17f-df36079e6540 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:45.549211 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-e390cddb-dc47-4a68-a17f-df36079e6540 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:45.570900 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.objects.instance [None req-e390cddb-dc47-4a68-a17f-df36079e6540 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lazy-loading 'flavor' on Instance uuid 2ca06c81-b73e-4443-87b2-4f6c071b4bc3 {{(pid=116104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 27 14:36:45.639198 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-e390cddb-dc47-4a68-a17f-df36079e6540 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "POST /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3/action" status: 202 len: 0 microversion: 2.1 time: 0.101814 Dec 27 14:36:45.639811 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 706/1436] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:36:45 2021] POST /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:36:45.647853 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c093a395-0b3b-46fa-9eec-966264542936 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:45.648462 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c093a395-0b3b-46fa-9eec-966264542936 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:45.656517 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c093a395-0b3b-46fa-9eec-966264542936 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:45.656969 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c093a395-0b3b-46fa-9eec-966264542936 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:45.658010 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c093a395-0b3b-46fa-9eec-966264542936 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:45.658441 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c093a395-0b3b-46fa-9eec-966264542936 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:46.013115 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c093a395-0b3b-46fa-9eec-966264542936 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:36:46.020383 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c093a395-0b3b-46fa-9eec-966264542936 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1570 microversion: 2.1 time: 0.376275 Dec 27 14:36:46.020944 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 731/1437] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:36:45 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1570 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:36:47.039638 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-fd1652bd-61e1-45c5-a950-ed5ae5b561ef tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:47.040376 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-fd1652bd-61e1-45c5-a950-ed5ae5b561ef tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:47.046834 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd1652bd-61e1-45c5-a950-ed5ae5b561ef tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:47.047288 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd1652bd-61e1-45c5-a950-ed5ae5b561ef tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:47.048101 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd1652bd-61e1-45c5-a950-ed5ae5b561ef tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:47.048598 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-fd1652bd-61e1-45c5-a950-ed5ae5b561ef tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:47.238329 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-fd1652bd-61e1-45c5-a950-ed5ae5b561ef tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:36:47.245691 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-fd1652bd-61e1-45c5-a950-ed5ae5b561ef tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1570 microversion: 2.1 time: 0.210552 Dec 27 14:36:47.246391 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 707/1438] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:36:47 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1570 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:36:48.262763 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fa4b6463-2c89-497e-9ba7-5a35ad09496c tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:48.263379 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fa4b6463-2c89-497e-9ba7-5a35ad09496c tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:48.269761 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fa4b6463-2c89-497e-9ba7-5a35ad09496c tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:48.270215 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fa4b6463-2c89-497e-9ba7-5a35ad09496c tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:48.270997 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fa4b6463-2c89-497e-9ba7-5a35ad09496c tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:48.271437 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fa4b6463-2c89-497e-9ba7-5a35ad09496c tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:48.398490 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-fa4b6463-2c89-497e-9ba7-5a35ad09496c tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:36:48.406692 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fa4b6463-2c89-497e-9ba7-5a35ad09496c tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1570 microversion: 2.1 time: 0.148193 Dec 27 14:36:48.407286 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 732/1439] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:36:48 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:36:49.424263 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7e14dd36-06f5-4df5-856f-6144e66f9b6f tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:49.424816 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7e14dd36-06f5-4df5-856f-6144e66f9b6f tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:49.431021 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e14dd36-06f5-4df5-856f-6144e66f9b6f tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:49.431466 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e14dd36-06f5-4df5-856f-6144e66f9b6f tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:49.432340 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e14dd36-06f5-4df5-856f-6144e66f9b6f tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:49.432768 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7e14dd36-06f5-4df5-856f-6144e66f9b6f tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:49.563354 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7e14dd36-06f5-4df5-856f-6144e66f9b6f tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:36:49.570606 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7e14dd36-06f5-4df5-856f-6144e66f9b6f tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1570 microversion: 2.1 time: 0.150090 Dec 27 14:36:49.571161 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 708/1440] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:36:49 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:36:50.587639 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-c35e32ad-2444-4894-9774-28c25c4bc2af tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:50.588281 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-c35e32ad-2444-4894-9774-28c25c4bc2af tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:50.594708 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c35e32ad-2444-4894-9774-28c25c4bc2af tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:50.595110 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c35e32ad-2444-4894-9774-28c25c4bc2af tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:50.595928 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c35e32ad-2444-4894-9774-28c25c4bc2af tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:50.596368 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-c35e32ad-2444-4894-9774-28c25c4bc2af tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:50.728955 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-c35e32ad-2444-4894-9774-28c25c4bc2af tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:36:50.736445 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-c35e32ad-2444-4894-9774-28c25c4bc2af tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1570 microversion: 2.1 time: 0.152467 Dec 27 14:36:50.737015 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 733/1441] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:36:50 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:36:51.753220 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-af345153-eb30-4bf3-81e6-d14da5c83e0a tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:51.753833 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-af345153-eb30-4bf3-81e6-d14da5c83e0a tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:51.760151 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-af345153-eb30-4bf3-81e6-d14da5c83e0a tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:51.760601 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-af345153-eb30-4bf3-81e6-d14da5c83e0a tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:51.761389 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-af345153-eb30-4bf3-81e6-d14da5c83e0a tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:51.762527 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-af345153-eb30-4bf3-81e6-d14da5c83e0a tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:51.891732 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-af345153-eb30-4bf3-81e6-d14da5c83e0a tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:36:51.899008 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-af345153-eb30-4bf3-81e6-d14da5c83e0a tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1570 microversion: 2.1 time: 0.149470 Dec 27 14:36:51.899574 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 709/1442] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:36:51 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:36:52.915361 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-d37e550c-6c50-4a03-a9f2-cdd7cddf8a45 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:52.916024 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-d37e550c-6c50-4a03-a9f2-cdd7cddf8a45 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:52.923097 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d37e550c-6c50-4a03-a9f2-cdd7cddf8a45 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:52.923569 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d37e550c-6c50-4a03-a9f2-cdd7cddf8a45 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:52.924365 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d37e550c-6c50-4a03-a9f2-cdd7cddf8a45 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:52.924796 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-d37e550c-6c50-4a03-a9f2-cdd7cddf8a45 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:53.056544 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-d37e550c-6c50-4a03-a9f2-cdd7cddf8a45 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:36:53.064154 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-d37e550c-6c50-4a03-a9f2-cdd7cddf8a45 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1570 microversion: 2.1 time: 0.152441 Dec 27 14:36:53.064732 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 734/1443] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:36:52 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:36:54.080719 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-03b45370-06d7-41cd-9591-6a7a1476e5e2 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:54.081323 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-03b45370-06d7-41cd-9591-6a7a1476e5e2 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:54.087555 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03b45370-06d7-41cd-9591-6a7a1476e5e2 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:54.088032 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03b45370-06d7-41cd-9591-6a7a1476e5e2 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:54.088811 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03b45370-06d7-41cd-9591-6a7a1476e5e2 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:54.089242 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-03b45370-06d7-41cd-9591-6a7a1476e5e2 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:54.222335 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-03b45370-06d7-41cd-9591-6a7a1476e5e2 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:36:54.229635 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-03b45370-06d7-41cd-9591-6a7a1476e5e2 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1570 microversion: 2.1 time: 0.152547 Dec 27 14:36:54.230228 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 710/1444] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:36:54 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:36:55.247243 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-fb182031-1f67-484f-99e4-e62b0a7bacc9 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:55.247932 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-fb182031-1f67-484f-99e4-e62b0a7bacc9 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:55.254237 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fb182031-1f67-484f-99e4-e62b0a7bacc9 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:55.254682 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fb182031-1f67-484f-99e4-e62b0a7bacc9 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:55.255460 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fb182031-1f67-484f-99e4-e62b0a7bacc9 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:55.255919 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-fb182031-1f67-484f-99e4-e62b0a7bacc9 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:55.393369 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-fb182031-1f67-484f-99e4-e62b0a7bacc9 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:36:55.400782 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-fb182031-1f67-484f-99e4-e62b0a7bacc9 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1570 microversion: 2.1 time: 0.157795 Dec 27 14:36:55.401358 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 735/1445] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:36:55 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:36:56.419079 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-515140c3-8b91-4e78-9dc4-c2cdbbb38ec6 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:56.419592 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-515140c3-8b91-4e78-9dc4-c2cdbbb38ec6 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:56.425876 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-515140c3-8b91-4e78-9dc4-c2cdbbb38ec6 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:56.426321 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-515140c3-8b91-4e78-9dc4-c2cdbbb38ec6 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:56.427102 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-515140c3-8b91-4e78-9dc4-c2cdbbb38ec6 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:56.427535 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-515140c3-8b91-4e78-9dc4-c2cdbbb38ec6 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:56.555914 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-515140c3-8b91-4e78-9dc4-c2cdbbb38ec6 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:36:56.563287 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-515140c3-8b91-4e78-9dc4-c2cdbbb38ec6 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1570 microversion: 2.1 time: 0.148510 Dec 27 14:36:56.563860 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 711/1446] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:36:56 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:36:57.582603 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-a3f0d31f-926f-46d7-8213-579be3c46f28 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:57.583229 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-a3f0d31f-926f-46d7-8213-579be3c46f28 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:57.591514 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a3f0d31f-926f-46d7-8213-579be3c46f28 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:57.592088 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a3f0d31f-926f-46d7-8213-579be3c46f28 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:57.593314 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a3f0d31f-926f-46d7-8213-579be3c46f28 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:57.593757 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-a3f0d31f-926f-46d7-8213-579be3c46f28 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:57.735621 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-a3f0d31f-926f-46d7-8213-579be3c46f28 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:36:57.743271 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-a3f0d31f-926f-46d7-8213-579be3c46f28 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1570 microversion: 2.1 time: 0.166730 Dec 27 14:36:57.743855 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 736/1447] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:36:57 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:36:58.760529 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-1f3d389e-5eb8-4684-987d-cf8df5f96a49 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:58.761138 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-1f3d389e-5eb8-4684-987d-cf8df5f96a49 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:58.767515 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1f3d389e-5eb8-4684-987d-cf8df5f96a49 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:58.768014 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1f3d389e-5eb8-4684-987d-cf8df5f96a49 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:58.768802 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1f3d389e-5eb8-4684-987d-cf8df5f96a49 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:58.769241 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-1f3d389e-5eb8-4684-987d-cf8df5f96a49 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:58.897708 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-1f3d389e-5eb8-4684-987d-cf8df5f96a49 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:36:58.905670 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-1f3d389e-5eb8-4684-987d-cf8df5f96a49 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1511 microversion: 2.1 time: 0.148863 Dec 27 14:36:58.906236 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 712/1448] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:36:58 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:36:58.922492 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-018463a9-a243-4d3f-9e7b-31625792b6ea tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:36:58.923039 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-018463a9-a243-4d3f-9e7b-31625792b6ea tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:58.929303 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-018463a9-a243-4d3f-9e7b-31625792b6ea tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:58.929751 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-018463a9-a243-4d3f-9e7b-31625792b6ea tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:58.930522 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-018463a9-a243-4d3f-9e7b-31625792b6ea tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:58.930951 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-018463a9-a243-4d3f-9e7b-31625792b6ea tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:59.003030 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-018463a9-a243-4d3f-9e7b-31625792b6ea tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "POST /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3/action" status: 202 len: 0 microversion: 2.1 time: 0.084319 Dec 27 14:36:59.003905 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 737/1449] 10.222.0.37 () {60 vars in 1277 bytes} [Mon Dec 27 14:36:58 2021] POST /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:36:59.012094 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-d93cf3c7-fac4-4dad-ac5a-3511c3bb5476 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:36:59.012657 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-d93cf3c7-fac4-4dad-ac5a-3511c3bb5476 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:36:59.018780 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d93cf3c7-fac4-4dad-ac5a-3511c3bb5476 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:59.019214 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d93cf3c7-fac4-4dad-ac5a-3511c3bb5476 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:59.020118 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d93cf3c7-fac4-4dad-ac5a-3511c3bb5476 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:36:59.020554 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-d93cf3c7-fac4-4dad-ac5a-3511c3bb5476 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:36:59.189871 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-d93cf3c7-fac4-4dad-ac5a-3511c3bb5476 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:36:59.202626 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-d93cf3c7-fac4-4dad-ac5a-3511c3bb5476 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1519 microversion: 2.1 time: 0.194853 Dec 27 14:36:59.203252 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 713/1450] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:36:59 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:37:00.220538 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-e017850b-cfc7-4de7-b308-c4d7bc32763e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:37:00.221143 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-e017850b-cfc7-4de7-b308-c4d7bc32763e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:37:00.227477 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e017850b-cfc7-4de7-b308-c4d7bc32763e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:37:00.227977 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e017850b-cfc7-4de7-b308-c4d7bc32763e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:37:00.228759 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e017850b-cfc7-4de7-b308-c4d7bc32763e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:37:00.229196 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-e017850b-cfc7-4de7-b308-c4d7bc32763e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:37:00.359782 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-e017850b-cfc7-4de7-b308-c4d7bc32763e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:37:00.367749 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-e017850b-cfc7-4de7-b308-c4d7bc32763e tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1577 microversion: 2.1 time: 0.150915 Dec 27 14:37:00.368355 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 738/1451] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:37:00 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:37:01.385181 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-41a61a71-a39a-4dea-a8ea-d2e1bcb2d98b tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:37:01.385791 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-41a61a71-a39a-4dea-a8ea-d2e1bcb2d98b tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:37:01.392237 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41a61a71-a39a-4dea-a8ea-d2e1bcb2d98b tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:37:01.392690 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41a61a71-a39a-4dea-a8ea-d2e1bcb2d98b tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:37:01.393515 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41a61a71-a39a-4dea-a8ea-d2e1bcb2d98b tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:37:01.394003 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-41a61a71-a39a-4dea-a8ea-d2e1bcb2d98b tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:37:01.524580 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-41a61a71-a39a-4dea-a8ea-d2e1bcb2d98b tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:37:01.531878 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-41a61a71-a39a-4dea-a8ea-d2e1bcb2d98b tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1577 microversion: 2.1 time: 0.150342 Dec 27 14:37:01.532446 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 714/1452] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:37:01 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:37:02.075514 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-5748bdec-be87-4056-809f-dc4b3217573e req-b864ba3d-9f5b-4b72-93f2-5b71dcec3517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca06c81-b73e-4443-87b2-4f6c071b4bc3", "name": "network-vif-unplugged", "status": "completed", "tag": "ff0e66a2-6e25-4756-9e65-7d16cfb02fdb"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:37:02.077107 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:37:02.077107 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:37:02.084448 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-5748bdec-be87-4056-809f-dc4b3217573e req-b864ba3d-9f5b-4b72-93f2-5b71dcec3517 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:37:02.084901 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-5748bdec-be87-4056-809f-dc4b3217573e req-b864ba3d-9f5b-4b72-93f2-5b71dcec3517 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:37:02.097115 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-5748bdec-be87-4056-809f-dc4b3217573e req-b864ba3d-9f5b-4b72-93f2-5b71dcec3517 service nova] Creating event network-vif-unplugged:ff0e66a2-6e25-4756-9e65-7d16cfb02fdb for instance 2ca06c81-b73e-4443-87b2-4f6c071b4bc3 on hv-cinder-82301 Dec 27 14:37:02.102011 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-5748bdec-be87-4056-809f-dc4b3217573e req-b864ba3d-9f5b-4b72-93f2-5b71dcec3517 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030975 Dec 27 14:37:02.102606 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 739/1453] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:37:02 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:37:02.549095 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-7a863543-1218-4132-bcc2-2702ed51aeab tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:37:02.549702 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-7a863543-1218-4132-bcc2-2702ed51aeab tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:37:02.555970 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a863543-1218-4132-bcc2-2702ed51aeab tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:37:02.556416 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a863543-1218-4132-bcc2-2702ed51aeab tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:37:02.557188 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a863543-1218-4132-bcc2-2702ed51aeab tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:37:02.557619 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-7a863543-1218-4132-bcc2-2702ed51aeab tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:37:02.685462 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-7a863543-1218-4132-bcc2-2702ed51aeab tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:37:02.692684 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-7a863543-1218-4132-bcc2-2702ed51aeab tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1577 microversion: 2.1 time: 0.147215 Dec 27 14:37:02.693245 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 715/1454] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:37:02 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1577 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:37:03.710500 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-964f3c99-ceec-40f0-8f71-86974504b26d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:37:03.711196 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-964f3c99-ceec-40f0-8f71-86974504b26d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:37:03.718021 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-964f3c99-ceec-40f0-8f71-86974504b26d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:37:03.718484 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-964f3c99-ceec-40f0-8f71-86974504b26d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:37:03.719240 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-964f3c99-ceec-40f0-8f71-86974504b26d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:37:03.719669 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-964f3c99-ceec-40f0-8f71-86974504b26d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:37:03.853469 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-964f3c99-ceec-40f0-8f71-86974504b26d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:37:03.860788 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-964f3c99-ceec-40f0-8f71-86974504b26d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1577 microversion: 2.1 time: 0.154719 Dec 27 14:37:03.861406 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 740/1455] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:37:03 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:37:04.878182 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-bf176e1d-1377-4f92-9669-91ce06477f9a tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:37:04.878792 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-bf176e1d-1377-4f92-9669-91ce06477f9a tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:37:04.885015 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bf176e1d-1377-4f92-9669-91ce06477f9a tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:37:04.885470 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bf176e1d-1377-4f92-9669-91ce06477f9a tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:37:04.886269 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bf176e1d-1377-4f92-9669-91ce06477f9a tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:37:04.887337 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-bf176e1d-1377-4f92-9669-91ce06477f9a tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:37:05.033818 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-bf176e1d-1377-4f92-9669-91ce06477f9a tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:37:05.041897 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-bf176e1d-1377-4f92-9669-91ce06477f9a tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1577 microversion: 2.1 time: 0.167726 Dec 27 14:37:05.042478 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 716/1456] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:37:04 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:37:06.058705 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-4eef4bdc-e491-4e61-b319-8373587d0e50 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:37:06.059329 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-4eef4bdc-e491-4e61-b319-8373587d0e50 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:37:06.065729 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4eef4bdc-e491-4e61-b319-8373587d0e50 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:37:06.066180 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4eef4bdc-e491-4e61-b319-8373587d0e50 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:37:06.066950 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4eef4bdc-e491-4e61-b319-8373587d0e50 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:37:06.067382 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-4eef4bdc-e491-4e61-b319-8373587d0e50 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:37:06.197184 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-4eef4bdc-e491-4e61-b319-8373587d0e50 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:37:06.204936 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-4eef4bdc-e491-4e61-b319-8373587d0e50 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1577 microversion: 2.1 time: 0.149915 Dec 27 14:37:06.205537 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 741/1457] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:37:06 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:37:07.221461 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-3bc74218-6716-4611-ab3f-17f083e98509 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:37:07.222101 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-3bc74218-6716-4611-ab3f-17f083e98509 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:37:07.228539 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3bc74218-6716-4611-ab3f-17f083e98509 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:37:07.228990 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3bc74218-6716-4611-ab3f-17f083e98509 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:37:07.229777 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3bc74218-6716-4611-ab3f-17f083e98509 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:37:07.230867 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-3bc74218-6716-4611-ab3f-17f083e98509 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:37:07.364924 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-3bc74218-6716-4611-ab3f-17f083e98509 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:37:07.372261 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-3bc74218-6716-4611-ab3f-17f083e98509 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1577 microversion: 2.1 time: 0.154429 Dec 27 14:37:07.372830 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 717/1458] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:37:07 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:37:08.388132 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ca8c007e-cfb8-4875-b408-3ad470c9cf1f tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:37:08.388698 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ca8c007e-cfb8-4875-b408-3ad470c9cf1f tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:37:08.395001 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ca8c007e-cfb8-4875-b408-3ad470c9cf1f tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:37:08.395454 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ca8c007e-cfb8-4875-b408-3ad470c9cf1f tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:37:08.396279 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ca8c007e-cfb8-4875-b408-3ad470c9cf1f tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:37:08.396714 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ca8c007e-cfb8-4875-b408-3ad470c9cf1f tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:37:08.532469 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-ca8c007e-cfb8-4875-b408-3ad470c9cf1f tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:37:08.540043 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ca8c007e-cfb8-4875-b408-3ad470c9cf1f tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1577 microversion: 2.1 time: 0.155651 Dec 27 14:37:08.540612 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 742/1459] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:37:08 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:37:09.556931 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-c9f38b0b-f4d1-4a37-985c-1ac55b44444d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:37:09.557534 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-c9f38b0b-f4d1-4a37-985c-1ac55b44444d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:37:09.563860 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c9f38b0b-f4d1-4a37-985c-1ac55b44444d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:37:09.564315 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c9f38b0b-f4d1-4a37-985c-1ac55b44444d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:37:09.565102 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c9f38b0b-f4d1-4a37-985c-1ac55b44444d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:37:09.565568 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-c9f38b0b-f4d1-4a37-985c-1ac55b44444d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:37:09.697349 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-c9f38b0b-f4d1-4a37-985c-1ac55b44444d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:37:09.704956 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-c9f38b0b-f4d1-4a37-985c-1ac55b44444d tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1564 microversion: 2.1 time: 0.151735 Dec 27 14:37:09.705522 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 718/1460] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:37:09 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:37:10.164730 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-f4ef1efd-8893-4f88-9464-5e6b680b8ff6 req-17c6baf7-7843-411a-9898-00f3e30cfd48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca06c81-b73e-4443-87b2-4f6c071b4bc3", "name": "network-vif-plugged", "status": "completed", "tag": "ff0e66a2-6e25-4756-9e65-7d16cfb02fdb"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:37:10.166240 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:37:10.166240 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:37:10.175133 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-f4ef1efd-8893-4f88-9464-5e6b680b8ff6 req-17c6baf7-7843-411a-9898-00f3e30cfd48 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:37:10.176309 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-f4ef1efd-8893-4f88-9464-5e6b680b8ff6 req-17c6baf7-7843-411a-9898-00f3e30cfd48 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:37:10.187429 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-f4ef1efd-8893-4f88-9464-5e6b680b8ff6 req-17c6baf7-7843-411a-9898-00f3e30cfd48 service nova] Creating event network-vif-plugged:ff0e66a2-6e25-4756-9e65-7d16cfb02fdb for instance 2ca06c81-b73e-4443-87b2-4f6c071b4bc3 on hv-cinder-82301 Dec 27 14:37:10.192475 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-f4ef1efd-8893-4f88-9464-5e6b680b8ff6 req-17c6baf7-7843-411a-9898-00f3e30cfd48 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031457 Dec 27 14:37:10.193414 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 743/1461] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:37:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:37:37.030443 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 27 14:37:37.031057 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: Mon Dec 27 14:37:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 27 14:37:57.483758 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 27 14:37:57.484479 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: Mon Dec 27 14:37:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 27 14:38:38.615723 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-ac35cada-e2e4-4e12-81ce-c25bf89e0325 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:38:38.616413 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ac35cada-e2e4-4e12-81ce-c25bf89e0325 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:38:38.618391 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-f14e55be-8f7b-404a-9001-3f94d7a3207d req-27d00e04-b1c3-4611-9dec-4a5dea7a4658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ca06c81-b73e-4443-87b2-4f6c071b4bc3", "tag": "ff0e66a2-6e25-4756-9e65-7d16cfb02fdb"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:38:38.619921 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:38:38.619921 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:38:38.622594 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac35cada-e2e4-4e12-81ce-c25bf89e0325 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:38:38.623108 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac35cada-e2e4-4e12-81ce-c25bf89e0325 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:38:38.624001 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac35cada-e2e4-4e12-81ce-c25bf89e0325 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:38:38.625025 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-ac35cada-e2e4-4e12-81ce-c25bf89e0325 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:38:38.628214 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-f14e55be-8f7b-404a-9001-3f94d7a3207d req-27d00e04-b1c3-4611-9dec-4a5dea7a4658 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:38:38.628662 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-f14e55be-8f7b-404a-9001-3f94d7a3207d req-27d00e04-b1c3-4611-9dec-4a5dea7a4658 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:38:38.641947 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-f14e55be-8f7b-404a-9001-3f94d7a3207d req-27d00e04-b1c3-4611-9dec-4a5dea7a4658 service nova] Creating event network-changed:ff0e66a2-6e25-4756-9e65-7d16cfb02fdb for instance 2ca06c81-b73e-4443-87b2-4f6c071b4bc3 on hv-cinder-82301 Dec 27 14:38:38.648051 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-f14e55be-8f7b-404a-9001-3f94d7a3207d req-27d00e04-b1c3-4611-9dec-4a5dea7a4658 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034562 Dec 27 14:38:38.648758 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 744/1462] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:38:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 27 14:38:38.651987 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-ac35cada-e2e4-4e12-81ce-c25bf89e0325 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Going to try to terminate instance {{(pid=116104) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 27 14:38:38.745090 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-ac35cada-e2e4-4e12-81ce-c25bf89e0325 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "DELETE /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 204 len: 0 microversion: 2.1 time: 0.134223 Dec 27 14:38:38.748716 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 719/1463] 10.222.0.37 () {58 vars in 1238 bytes} [Mon Dec 27 14:38:38 2021] DELETE /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 27 14:38:38.755012 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-9ddf7778-182c-467c-b833-d6bac4a50670 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:38:38.755702 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-9ddf7778-182c-467c-b833-d6bac4a50670 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:38:38.762292 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ddf7778-182c-467c-b833-d6bac4a50670 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:38:38.762995 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ddf7778-182c-467c-b833-d6bac4a50670 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:38:38.764027 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ddf7778-182c-467c-b833-d6bac4a50670 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:38:38.764653 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-9ddf7778-182c-467c-b833-d6bac4a50670 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:38:38.973756 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.policy [None req-9ddf7778-182c-467c-b833-d6bac4a50670 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116105) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:38:38.981415 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-9ddf7778-182c-467c-b833-d6bac4a50670 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1570 microversion: 2.1 time: 0.230900 Dec 27 14:38:38.981986 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 745/1464] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:38:38 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1570 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 27 14:38:39.998885 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-21678218-a96e-4b89-b39b-d1e661b2a3b1 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:38:40.000463 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-21678218-a96e-4b89-b39b-d1e661b2a3b1 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:38:40.006941 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21678218-a96e-4b89-b39b-d1e661b2a3b1 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:38:40.007395 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21678218-a96e-4b89-b39b-d1e661b2a3b1 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:38:40.008222 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21678218-a96e-4b89-b39b-d1e661b2a3b1 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:38:40.008662 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-21678218-a96e-4b89-b39b-d1e661b2a3b1 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:38:40.143508 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-21678218-a96e-4b89-b39b-d1e661b2a3b1 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:38:40.150934 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-21678218-a96e-4b89-b39b-d1e661b2a3b1 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1451 microversion: 2.1 time: 0.156083 Dec 27 14:38:40.151484 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 720/1465] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:38:39 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:38:40.874910 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [req-32c7daee-bbc9-465f-a570-e7e6cb3f5d86 req-0828c33e-8451-46f8-8597-80281ba47103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca06c81-b73e-4443-87b2-4f6c071b4bc3", "name": "network-vif-deleted", "tag": "ff0e66a2-6e25-4756-9e65-7d16cfb02fdb"}]} {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 27 14:38:40.876874 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 27 14:38:40.876874 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: warnings.warn(msg) Dec 27 14:38:40.886082 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-32c7daee-bbc9-465f-a570-e7e6cb3f5d86 req-0828c33e-8451-46f8-8597-80281ba47103 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:38:40.886562 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [req-32c7daee-bbc9-465f-a570-e7e6cb3f5d86 req-0828c33e-8451-46f8-8597-80281ba47103 service nova] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:38:40.898549 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.compute.server_external_events [req-32c7daee-bbc9-465f-a570-e7e6cb3f5d86 req-0828c33e-8451-46f8-8597-80281ba47103 service nova] Creating event network-vif-deleted:ff0e66a2-6e25-4756-9e65-7d16cfb02fdb for instance 2ca06c81-b73e-4443-87b2-4f6c071b4bc3 on hv-cinder-82301 Dec 27 14:38:40.903220 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [req-32c7daee-bbc9-465f-a570-e7e6cb3f5d86 req-0828c33e-8451-46f8-8597-80281ba47103 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032442 Dec 27 14:38:40.903800 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 746/1466] 10.222.0.37 () {64 vars in 1317 bytes} [Mon Dec 27 14:38:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 27 14:38:41.167676 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-66f2ef2b-570f-4eae-846d-6e7721d4d368 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:38:41.168445 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.compute.api [None req-66f2ef2b-570f-4eae-846d-6e7721d4d368 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116104) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:38:41.175787 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66f2ef2b-570f-4eae-846d-6e7721d4d368 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:38:41.176531 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66f2ef2b-570f-4eae-846d-6e7721d4d368 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:38:41.177486 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66f2ef2b-570f-4eae-846d-6e7721d4d368 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:38:41.178097 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG oslo_concurrency.lockutils [None req-66f2ef2b-570f-4eae-846d-6e7721d4d368 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:38:41.257147 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.policy [None req-66f2ef2b-570f-4eae-846d-6e7721d4d368 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02377006837941538f72bfe91e6c5b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a36edf49e96743a5995f7dedca7f0b38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116104) authorize /opt/stack/nova/nova/policy.py:199}} Dec 27 14:38:41.265635 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-66f2ef2b-570f-4eae-846d-6e7721d4d368 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 200 len: 1219 microversion: 2.1 time: 0.100930 Dec 27 14:38:41.266229 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 721/1467] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:38:41 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 27 14:38:42.282790 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ca9d3abf-287d-46a4-b444-3a0ebef7e910 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '>' {{(pid=116105) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:38:42.283476 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.compute.api [None req-ca9d3abf-287d-46a4-b444-3a0ebef7e910 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] [instance: 2ca06c81-b73e-4443-87b2-4f6c071b4bc3] Fetching instance by UUID {{(pid=116105) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 27 14:38:42.289814 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ca9d3abf-287d-46a4-b444-3a0ebef7e910 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:38:42.290263 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ca9d3abf-287d-46a4-b444-3a0ebef7e910 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:38:42.291022 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ca9d3abf-287d-46a4-b444-3a0ebef7e910 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 27 14:38:42.291446 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG oslo_concurrency.lockutils [None req-ca9d3abf-287d-46a4-b444-3a0ebef7e910 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Lock "2a3c8460-53d0-49c1-9a80-ca19cb7dcbd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116105) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 27 14:38:42.304624 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.wsgi [None req-ca9d3abf-287d-46a4-b444-3a0ebef7e910 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] HTTP exception thrown: Instance 2ca06c81-b73e-4443-87b2-4f6c071b4bc3 could not be found. Dec 27 14:38:42.305198 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: DEBUG nova.api.openstack.wsgi [None req-ca9d3abf-287d-46a4-b444-3a0ebef7e910 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Returning 404 to user: Instance 2ca06c81-b73e-4443-87b2-4f6c071b4bc3 could not be found. {{(pid=116105) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 27 14:38:42.305995 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO nova.api.openstack.requestlog [None req-ca9d3abf-287d-46a4-b444-3a0ebef7e910 tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3" status: 404 len: 111 microversion: 2.1 time: 0.027796 Dec 27 14:38:42.306501 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: [pid: 116105|app: 0|req: 747/1468] 10.222.0.37 () {58 vars in 1235 bytes} [Mon Dec 27 14:38:42 2021] GET /compute/v2.1/servers/2ca06c81-b73e-4443-87b2-4f6c071b4bc3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 27 14:38:42.459514 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: DEBUG nova.api.openstack.wsgi [None req-08bf72ad-0de6-4686-9ebf-6db4c8c7b3bd tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] Calling method '.version_select at 0x7f8028e07b80>' {{(pid=116104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 27 14:38:42.481937 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO nova.api.openstack.requestlog [None req-08bf72ad-0de6-4686-9ebf-6db4c8c7b3bd tempest-TestShelveInstance-2063231175 tempest-TestShelveInstance-2063231175-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1026104980" status: 202 len: 0 microversion: 2.1 time: 0.025874 Dec 27 14:38:42.482768 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: [pid: 116104|app: 0|req: 722/1469] 10.222.0.37 () {58 vars in 1253 bytes} [Mon Dec 27 14:38:42 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1026104980 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 27 14:39:41.446366 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 27 14:39:41.446925 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: Mon Dec 27 14:39:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 27 14:41:17.491987 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 27 14:41:17.492595 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: Mon Dec 27 14:41:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 27 14:41:33.521341 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 27 14:41:33.522042 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: Mon Dec 27 14:41:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 27 14:41:42.555587 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 27 14:41:42.556174 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: Mon Dec 27 14:41:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 27 14:42:55.769996 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 27 14:42:55.770712 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: Mon Dec 27 14:42:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 27 14:43:01.455093 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 27 14:43:01.455726 dv-cinder-823015-1-iscsi devstack@n-api.service[116105]: Mon Dec 27 14:43:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 27 14:44:17.042166 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 27 14:44:17.042792 dv-cinder-823015-1-iscsi devstack@n-api.service[116104]: Mon Dec 27 14:44:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!